Sep 17 19:14:32 devstack cinder-volume[75319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 19:14:32 devstack cinder-volume[75319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 19:14:32 devstack cinder-volume[75319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 19:14:34 devstack cinder-volume[75319]: INFO dbcounter [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Registered counter for database cinder
Sep 17 19:14:34 devstack cinder-volume[75319]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:14:34 devstack cinder-volume[75319]: DEBUG dbcounter [-] [75319] Writer thread running {{(pid=75319) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 19:14:34 devstack cinder-volume[75319]: INFO cinder.rpc [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 17 19:14:34 devstack cinder-volume[75319]: INFO cinder.rpc [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 17 19:14:34 devstack cinder-volume[75319]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:14:34 devstack cinder-volume[75319]: INFO cinder.volume.manager [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Determined volume DB was empty at startup.
Sep 17 19:14:34 devstack cinder-volume[75319]: DEBUG cinder.volume.manager [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75319) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 17 19:14:34 devstack cinder-volume[75319]: INFO cinder.volume.manager [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 17 19:14:34 devstack cinder-volume[75319]: WARNING stevedore.named [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 19:14:34 devstack cinder-volume[75319]: WARNING castellan.key_manager [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 19:14:34 devstack cinder-volume[75319]: WARNING cinder.keymgr.conf_key_mgr [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 19:14:34 devstack cinder-volume[75319]: DEBUG cinder.volume.drivers.lvm [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75319) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 17 19:14:34 devstack cinder-volume[75319]: DEBUG oslo_concurrency.processutils [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:35 devstack cinder-volume[75319]: DEBUG oslo_concurrency.processutils [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] CMD "cinder-rtstool verify" returned: 0 in 1.015s {{(pid=75319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:14:36 devstack cinder-volume[75319]: INFO cinder.rpc [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 17 19:14:36 devstack cinder-volume[75319]: INFO cinder.rpc [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 17 19:14:36 devstack cinder-volume[75319]: WARNING stevedore.named [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 19:14:36 devstack cinder-volume[75319]: WARNING castellan.key_manager [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 19:14:36 devstack cinder-volume[75319]: INFO cinder.volume.manager [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:14:36 devstack cinder-volume[75319]: INFO oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Starting 1 workers
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Started child 75417 {{(pid=75319) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Full set of CONF: {{(pid=75319) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] ******************************************************************************** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Configuration options gathered from: {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] ================================================================================ {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] allow_availability_zone_fallback = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] allow_compression_on_image_upload = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] allowed_direct_url_schemes     = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] api_rate_limit                 = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] auth_strategy                  = keystone {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] az_cache_duration              = 3600 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_availability_zone      = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_host                   = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_name                   = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_stats_polling_interval = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backup_api_class               = cinder.backup.api.API {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backup_name_template           = backup-%s {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backup_use_same_host           = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backup_use_temp_snapshot       = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] chap_password                  = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] chap_username                  =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_internal_tenant_project_id = d46eeb6cf6214c7e9972c5e0ec6bc76a {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_internal_tenant_user_id = 4f74fab4eec04afbb4745a371c15bc78 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cloned_volume_same_az          = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cluster                        = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] compression_format             = gzip {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] compute_api_class              = cinder.compute.nova.API {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] config_dir                     = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] config_source                  = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] control_exchange               = openstack {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] debug                          = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] default_availability_zone      = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] default_group_type             = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] default_volume_type            = lvmdriver-1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] driver_client_cert             = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] driver_client_cert_key         = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] driver_data_namespace          = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] driver_ssl_cert_path           = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] driver_ssl_cert_verify         = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] driver_use_ssl                 = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75417]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] enable_force_upload            = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] enable_new_services            = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] enable_unsupported_driver      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] enforce_multipath_for_image_xfer = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] filter_function                = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_api_insecure            = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_api_servers             = ['http://192.168.122.179/image'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_api_ssl_compression     = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_ca_certificates_file    = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_catalog_info            = image:glance:publicURL {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_certfile                = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_keyfile                 = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_num_retries             = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance_request_timeout         = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] goodness_function              = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] graceful_shutdown_timeout      = 5 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] group_api_class                = cinder.group.api.API {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] host                           = devstack {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_compress_on_upload       = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_conversion_address_space_limit = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_conversion_cpu_limit     = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_conversion_disable       = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_upload_use_cinder_backend = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_upload_use_internal_tenant = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_volume_cache_enabled     = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_volume_cache_max_count   = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] image_volume_cache_max_size_gb = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] init_host_max_objects_retrieval = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] instance_format                = [instance: %(uuid)s]  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] iscsi_iotype                   = fileio {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] iscsi_target_flags             =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] iscsi_write_cache              = on {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] iser_helper                    = tgtadm {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] iser_ip_address                = 192.168.122.179 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] iser_port                      = 3260 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_color                      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_config_append              = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_dir                        = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_file                       = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_options                    = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_rotate_interval            = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_rotate_interval_type       = days {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] log_rotation_type              = none {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] max_age                        = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] max_logfile_count              = 30 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] max_logfile_size_mb            = 200 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] max_over_subscription_ratio    = 20.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] message_reap_interval          = 86400 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] message_ttl                    = 2592000 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] migration_create_volume_timeout_secs = 300 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] monkey_patch                   = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] monkey_patch_modules           = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] my_ip                          = 192.168.122.179 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] no_snapshot_gb_quota           = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] num_iser_scan_tries            = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] num_shell_tries                = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] num_volume_device_scan_tries   = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] nvmeof_conn_info_version       = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] nvmet_ns_id                    = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] nvmet_port_id                  = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] osapi_max_limit                = 1000 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] osapi_volume_ext_list          = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] osapi_volume_listen_port       = 8776 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] osapi_volume_use_ssl           = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] osapi_volume_workers           = 2 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] per_volume_size_limit          = -1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] periodic_fuzzy_delay           = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] periodic_interval              = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] public_endpoint                = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] publish_errors                 = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] quota_backup_gigabytes         = 1000 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] quota_backups                  = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] quota_gigabytes                = 1000 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] quota_groups                   = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] quota_snapshots                = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] quota_volumes                  = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] rate_limit_burst               = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] rate_limit_except_level        = CRITICAL {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] rate_limit_interval            = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] reinit_driver_count            = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] replication_device             = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] report_discard_supported       = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] report_interval                = 120 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] reservation_clean_interval     = 86400 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] reservation_expire             = 86400 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] reserved_image_namespaces      = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] reserved_percentage            = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] rpc_response_timeout           = 120 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] run_external_periodic_tasks    = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] scst_target_driver             = iscsi {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] scst_target_iqn_name           = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_down_time              = 720 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] shell_completion               = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] snapshot_name_template         = snapshot-%s {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] snapshot_same_host             = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] split_loggers                  = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] state_path                     = /opt/stack/data/cinder {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] storage_availability_zone      = nova {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] storage_protocol               = iSCSI {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] syslog_log_facility            = LOG_USER {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] target_helper                  = lioadm {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] target_ip_address              = 192.168.122.179 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] target_port                    = 3260 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] target_protocol                = iscsi {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] target_secondary_ip_addresses  = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] trace_flags                    = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] transport_url                  = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] until_refresh                  = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] use_chap_auth                  = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] use_default_quota_class        = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] use_journal                    = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] use_json                       = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] use_multipath_for_image_xfer   = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] use_stderr                     = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] use_syslog                     = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] verify_glance_signatures       = enabled {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_api_class               = cinder.volume.api.API {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_backend_name            = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_clear                   = zero {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_clear_ionice            = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_clear_size              = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_copy_bps_limit          = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_dd_blocksize            = 1M {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_name_template           = volume-%s {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_service_inithost_offload = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volume_usage_audit_period      = month {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] watch_log_file                 = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] zoning_mode                    = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_concurrency.disable_process_locking = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.admin_password = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.admin_token = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.admin_user  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.auth_port   = 35357 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.auth_protocol = https {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.auth_section = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.auth_type   = password {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.auth_uri    = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.auth_version = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.cache       = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.certfile    = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.identity_uri = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.include_service_catalog = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.insecure    = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.interface   = public {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.keyfile     = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_password =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcache_username =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.region_name = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.service_token_roles_required = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.service_type = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75417]: INFO cinder.volume.manager [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.backend                  = dogpile.cache.null {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.backend_argument         = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.backend_expiration_time  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.config_prefix            = cache.oslo {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.dead_timeout             = 60.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.debug_cache_backend      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.enable_retry_client      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.enable_socket_keepalive  = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.enabled                  = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.enforce_fips_mode        = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.expiration_time          = 600 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.hashclient_retry_attempts = 2 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_dead_retry      = 300 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_password        = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_pool_maxsize    = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_sasl_enabled    = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.memcache_username        = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.proxies                  = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.redis_db                 = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.redis_password           = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.redis_server             = localhost:6379 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.redis_socket_timeout     = 1.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.redis_username           = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.retry_attempts           = 2 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.retry_delay              = 0.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.socket_keepalive_count   = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.socket_keepalive_idle    = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.socket_keepalive_interval = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.tls_allowed_ciphers      = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.tls_cafile               = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.tls_certfile             = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.tls_enabled              = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cache.tls_keyfile              = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] coordination.backend_url       = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.asyncio_connection    = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.asyncio_slave_connection = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.backend               = sqlalchemy {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.connection            = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.connection_debug      = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.connection_parameters =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.connection_recycle_time = 3600 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.connection_trace      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.db_inc_retry_interval = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.db_max_retries        = 20 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.db_max_retry_interval = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.db_retry_interval     = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.max_overflow          = 50 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.max_pool_size         = 5 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.max_retries           = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.mysql_wsrep_sync_wait = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.pool_timeout          = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.retry_interval        = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.slave_connection      = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.sqlite_synchronous    = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] database.use_db_reconnect      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.connection_string     = messaging:// {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.enabled               = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.es_doc_type           = notification {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.es_scroll_size        = 10000 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.es_scroll_time        = 2m {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.filter_error_trace    = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.hmac_keys             = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.sentinel_service_name = mymaster {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.socket_timeout        = 0.1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.trace_requests        = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler.trace_sqlalchemy      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler_jaeger.process_tags   = {} {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler_jaeger.service_name_prefix = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] profiler_otlp.service_name_prefix = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.enforce_new_defaults = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: WARNING oslo_config.cfg [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.enforce_scope      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.policy_default_rule = default {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.policy_file        = policy.yaml {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] privsep_osbrick.group          = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] privsep_osbrick.helper_command = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] privsep_osbrick.user           = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_sys_admin.group         = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_sys_admin.helper_command = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] cinder_sys_admin.user          = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.auth_section      = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.auth_type         = password {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:36 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.139s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.certfile          = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.collect_timing    = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.insecure          = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.keyfile           = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.send_service_user_token = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.split_loggers     = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] service_user.timeout           = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.auth_section            = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.auth_type               = password {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.certfile                = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.collect_timing          = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.insecure                = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.keyfile                 = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.split_loggers           = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] glance.timeout                 = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.backend_availability_zone = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.chap_password = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.chap_username =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.driver_client_cert = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.driver_client_cert_key = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.driver_data_namespace = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.driver_use_ssl = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.extra_capabilities = {} {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.filter_function = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.goodness_function = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.iscsi_target_flags =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.iscsi_write_cache = on {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.iser_helper   = tgtadm {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.iser_ip_address = 192.168.122.179 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.iser_port     = 3260 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.lvm_share_target = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.lvm_type      = auto {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.num_shell_tries = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.replication_device = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.report_discard_supported = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.reserved_percentage = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.target_helper = tgtadm {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.target_ip_address = 192.168.122.179 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.target_port   = 3260 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.target_protocol = iscsi {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.trace_flags   = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.unique_fqdn_network = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.use_chap_auth = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_backend_name = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_clear  = zero {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_clear_ionice = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_clear_size = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_reports.file_event_handler = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_reports.log_dir           = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.backend_host       = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.chap_password      = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.chap_username      = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.driver_client_cert = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.extra_capabilities = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.filter_function    = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.goodness_function  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.iser_helper        = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.iser_ip_address    = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.iser_port          = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.lvm_share_target   = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.lvm_type           = auto {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.num_shell_tries    = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.replication_device = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.report_discard_supported = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.reserved_percentage = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.scst_target_driver = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.storage_protocol   = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.target_helper      = lioadm {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.target_ip_address  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.target_port        = 3260 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.trace_flags        = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.use_chap_auth      = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_clear       = zero {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_clear_size  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] lvmdriver-1.volumes_dir        = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.ssl      = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_notifications.driver = [] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_notifications.retry = -1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] key_manager.fixed_key          = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.barbican_api_version  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.barbican_endpoint     = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.barbican_endpoint_type = public {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.barbican_region_name  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.cafile                = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.certfile              = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.collect_timing        = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.insecure              = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.keyfile               = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.number_of_retries     = 60 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.retry_delay           = 1 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.send_service_user_token = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.split_loggers         = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.timeout               = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.verify_ssl            = True {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican.verify_ssl_path       = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.auth_section = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.auth_type = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.cafile   = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.certfile = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.collect_timing = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.insecure = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.keyfile  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.split_loggers = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] barbican_service_user.timeout  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.approle_role_id          = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.approle_secret_id        = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.kv_mountpoint            = secret {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.kv_path                  = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.kv_version               = 2 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.namespace                = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.root_token_id            = **** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.ssl_ca_crt_file          = None {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.timeout                  = 60.0 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.use_ssl                  = False {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:14:37 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] ******************************************************************************** {{(pid=75319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 17 19:14:37 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.229s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:37 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:37 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.143s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:37 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:37 devstack sudo[75472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 17 19:14:37 devstack sudo[75472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:14:39 devstack sudo[75472]: pam_unix(sudo:session): session closed for user root
Sep 17 19:14:39 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.163s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:39 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:39 devstack sudo[75618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:14:39 devstack sudo[75618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:14:42 devstack sudo[75618]: pam_unix(sudo:session): session closed for user root
Sep 17 19:14:42 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.333s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:42 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:14:42 devstack cinder-volume[75417]: INFO cinder.brick.local_dev.lvm [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 17 19:14:42 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:42 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:42 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:42 devstack sudo[75726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:14:42 devstack sudo[75726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:14:44 devstack sudo[75726]: pam_unix(sudo:session): session closed for user root
Sep 17 19:14:44 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.074s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:44 devstack cinder-volume[75417]: DEBUG cinder.brick.local_dev.lvm [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75417) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 17 19:14:44 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:44 devstack sudo[75816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:14:44 devstack sudo[75816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:14:46 devstack cinder-volume[75319]: DEBUG dbcounter [-] [75319] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75319) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:14:47 devstack sudo[75816]: pam_unix(sudo:session): session closed for user root
Sep 17 19:14:47 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.400s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:47 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:47 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.119s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:47 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:48 devstack sudo[76020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:14:48 devstack sudo[76020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:14:49 devstack sudo[76020]: pam_unix(sudo:session): session closed for user root
Sep 17 19:14:49 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.029s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:49 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:50 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.127s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:50 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:50 devstack sudo[76058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 17 19:14:50 devstack sudo[76058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:14:52 devstack sudo[76058]: pam_unix(sudo:session): session closed for user root
Sep 17 19:14:52 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 1.908s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:52 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:52 devstack sudo[76066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:14:52 devstack sudo[76066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:14:54 devstack sudo[76066]: pam_unix(sudo:session): session closed for user root
Sep 17 19:14:55 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.975s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:55 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:55 devstack sudo[76149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:14:55 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:14:57 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root
Sep 17 19:14:57 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.278s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:14:57 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:14:57 devstack sudo[76154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:14:57 devstack sudo[76154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:00 devstack sudo[76154]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.856s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:00 devstack sudo[76158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:15:00 devstack sudo[76158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:02 devstack sudo[76158]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.347s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.114s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:02 devstack sudo[76166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:15:02 devstack sudo[76166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:04 devstack sudo[76166]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:04 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.148s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:05 devstack cinder-volume[75417]: INFO cinder.volume.drivers.lvm [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 17 19:15:05 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:05 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.084s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:05 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:05 devstack sudo[76234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:15:05 devstack sudo[76234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:07 devstack sudo[76234]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:07 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.951s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:07 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:15:07 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:07 devstack sudo[76299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:15:07 devstack sudo[76299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:09 devstack sudo[76299]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:09 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.989s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:09 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:09 devstack sudo[76429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:15:09 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:11 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:11 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.967s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:11 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:11 devstack sudo[76432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:15:11 devstack sudo[76432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:12 devstack sudo[76432]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:13 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.919s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:13 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:13 devstack sudo[76435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:15:13 devstack sudo[76435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:14 devstack sudo[76435]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:15 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.945s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:15 devstack cinder-volume[75417]: INFO cinder.volume.driver [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Driver hasn't implemented _init_vendor_properties()
Sep 17 19:15:15 devstack cinder-volume[75417]: DEBUG cinder.volume.driver [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75417) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 17 19:15:15 devstack cinder-volume[75417]: DEBUG oslo_db.sqlalchemy.engines [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:15:15 devstack cinder-volume[75417]: DEBUG dbcounter [-] [75417] Writer thread running {{(pid=75417) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 19:15:15 devstack cinder-volume[75417]: DEBUG cinder.db.sqlalchemy.api [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Building query based on filter {{(pid=75417) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 17 19:15:15 devstack cinder-volume[75417]: DEBUG cinder.image.image_utils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75417) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 17 19:15:15 devstack cinder-volume[75417]: INFO cinder.keymgr.migration [None req-c57cbce0-2223-4a19-9be9-29e0ccc1ed8b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 17 19:15:15 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:15:15 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:15 devstack sudo[76442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:15:15 devstack sudo[76442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:17 devstack sudo[76442]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:17 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.954s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:17 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:17 devstack sudo[76446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:15:17 devstack sudo[76446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:19 devstack sudo[76446]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:19 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.505s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:19 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:20 devstack sudo[76566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:15:20 devstack sudo[76566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:22 devstack sudo[76566]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:22 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.102s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:22 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:22 devstack sudo[76631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:15:22 devstack sudo[76631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:24 devstack sudo[76631]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:24 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.116s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:24 devstack cinder-volume[75417]: DEBUG cinder.manager [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Notifying Schedulers of capabilities ... {{(pid=75417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:15:24 devstack cinder-volume[75417]: INFO cinder.volume.manager [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Driver initialization completed successfully.
Sep 17 19:15:24 devstack cinder-volume[75417]: INFO cinder.manager [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Initiating service 2 cleanup
Sep 17 19:15:24 devstack cinder-volume[75417]: INFO cinder.manager [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Service 2 cleanup completed.
Sep 17 19:15:24 devstack cinder-volume[75417]: DEBUG cinder.service [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Creating RPC server for service cinder-volume {{(pid=75417) start /opt/stack/cinder/cinder/service.py:239}}
Sep 17 19:15:24 devstack cinder-volume[75417]: DEBUG cinder.service [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75417) start /opt/stack/cinder/cinder/service.py:245}}
Sep 17 19:15:24 devstack cinder-volume[75417]: INFO cinder.volume.manager [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 17 19:15:24 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:15:24 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:24 devstack sudo[76634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:15:24 devstack sudo[76634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:26 devstack sudo[76634]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:26 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.931s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:26 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:26 devstack sudo[76637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:15:26 devstack sudo[76637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:28 devstack sudo[76637]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:28 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.292s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:28 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:29 devstack sudo[76646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:15:29 devstack sudo[76646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:30 devstack sudo[76646]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:30 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.911s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:30 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:31 devstack sudo[76650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:15:31 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:33 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:33 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.331s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:33 devstack cinder-volume[75417]: INFO cinder.volume.manager [None req-cce6fe21-a980-4a00-8a77-c6d19a385d8e None None] Driver post RPC initialization completed successfully.
Sep 17 19:15:43 devstack cinder-volume[75417]: DEBUG dbcounter [-] [75417] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75417) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:15:43 devstack cinder-volume[75417]: DEBUG dbcounter [-] [75417] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75417) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:15:56 devstack cinder-volume[75417]: DEBUG oslo_service.periodic_task [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75417) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:15:56 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:15:56 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:56 devstack sudo[77284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:15:56 devstack sudo[77284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:15:58 devstack sudo[77284]: pam_unix(sudo:session): session closed for user root
Sep 17 19:15:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.901s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:15:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:15:58 devstack sudo[77343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:15:58 devstack sudo[77343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:16:00 devstack sudo[77343]: pam_unix(sudo:session): session closed for user root
Sep 17 19:16:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.971s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:16:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:16:00 devstack sudo[77405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:16:00 devstack sudo[77405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:16:02 devstack sudo[77405]: pam_unix(sudo:session): session closed for user root
Sep 17 19:16:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.029s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:16:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:16:02 devstack sudo[77480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:16:02 devstack sudo[77480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:16:04 devstack sudo[77480]: pam_unix(sudo:session): session closed for user root
Sep 17 19:16:04 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.002s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:16:04 devstack cinder-volume[75417]: DEBUG cinder.manager [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Notifying Schedulers of capabilities ... {{(pid=75417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:16:56 devstack cinder-volume[75417]: DEBUG oslo_service.periodic_task [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75417) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:16:56 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:16:56 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:16:56 devstack sudo[78063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:16:56 devstack sudo[78063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:16:58 devstack sudo[78063]: pam_unix(sudo:session): session closed for user root
Sep 17 19:16:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.885s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:16:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:16:58 devstack sudo[78078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:16:58 devstack sudo[78078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:17:00 devstack sudo[78078]: pam_unix(sudo:session): session closed for user root
Sep 17 19:17:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.760s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:17:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:17:00 devstack sudo[78089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:17:00 devstack sudo[78089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:17:01 devstack sudo[78089]: pam_unix(sudo:session): session closed for user root
Sep 17 19:17:01 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.744s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:17:01 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:17:02 devstack sudo[78097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:17:02 devstack sudo[78097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:17:03 devstack sudo[78097]: pam_unix(sudo:session): session closed for user root
Sep 17 19:17:03 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.980s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:17:03 devstack cinder-volume[75417]: DEBUG cinder.manager [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Notifying Schedulers of capabilities ... {{(pid=75417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:17:43 devstack cinder-volume[75417]: DEBUG dbcounter [-] [75417] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75417) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:17:56 devstack cinder-volume[75417]: DEBUG oslo_service.periodic_task [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75417) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:17:56 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:17:56 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:17:56 devstack sudo[79033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:17:56 devstack sudo[79033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:17:58 devstack sudo[79033]: pam_unix(sudo:session): session closed for user root
Sep 17 19:17:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.952s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:17:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:17:58 devstack sudo[79036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:17:58 devstack sudo[79036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:18:00 devstack sudo[79036]: pam_unix(sudo:session): session closed for user root
Sep 17 19:18:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.991s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:18:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:18:00 devstack sudo[79041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:18:00 devstack sudo[79041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:18:02 devstack sudo[79041]: pam_unix(sudo:session): session closed for user root
Sep 17 19:18:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.926s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:18:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:18:02 devstack sudo[79049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:18:02 devstack sudo[79049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:18:04 devstack sudo[79049]: pam_unix(sudo:session): session closed for user root
Sep 17 19:18:04 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.938s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:18:04 devstack cinder-volume[75417]: DEBUG cinder.manager [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Notifying Schedulers of capabilities ... {{(pid=75417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:18:56 devstack cinder-volume[75417]: DEBUG oslo_service.periodic_task [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75417) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:18:56 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:18:56 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:18:56 devstack sudo[81562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:18:56 devstack sudo[81562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:18:58 devstack sudo[81562]: pam_unix(sudo:session): session closed for user root
Sep 17 19:18:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.905s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:18:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:18:58 devstack sudo[81568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:18:58 devstack sudo[81568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:19:00 devstack sudo[81568]: pam_unix(sudo:session): session closed for user root
Sep 17 19:19:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.071s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:19:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:19:00 devstack sudo[81575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:19:00 devstack sudo[81575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:19:02 devstack sudo[81575]: pam_unix(sudo:session): session closed for user root
Sep 17 19:19:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.922s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:19:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:19:02 devstack sudo[81583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:19:02 devstack sudo[81583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:19:04 devstack sudo[81583]: pam_unix(sudo:session): session closed for user root
Sep 17 19:19:04 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.836s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:19:04 devstack cinder-volume[75417]: DEBUG cinder.manager [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Notifying Schedulers of capabilities ... {{(pid=75417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:19:43 devstack cinder-volume[75417]: DEBUG dbcounter [-] [75417] Writing DB stats cinder:SELECT=1 {{(pid=75417) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:19:43 devstack cinder-volume[75417]: DEBUG dbcounter [-] [75417] Writing DB stats cinder:UPDATE=1 {{(pid=75417) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:19:56 devstack cinder-volume[75417]: DEBUG oslo_service.periodic_task [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75417) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:19:56 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:19:56 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:19:56 devstack sudo[81866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:19:56 devstack sudo[81866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:19:58 devstack sudo[81866]: pam_unix(sudo:session): session closed for user root
Sep 17 19:19:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.981s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:19:58 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:19:58 devstack sudo[81869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:19:58 devstack sudo[81869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:20:00 devstack sudo[81869]: pam_unix(sudo:session): session closed for user root
Sep 17 19:20:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.999s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:20:00 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:20:00 devstack sudo[81873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:20:00 devstack sudo[81873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:20:02 devstack sudo[81873]: pam_unix(sudo:session): session closed for user root
Sep 17 19:20:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.734s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:20:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:20:02 devstack sudo[81878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:20:02 devstack sudo[81878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:20:03 devstack sudo[81878]: pam_unix(sudo:session): session closed for user root
Sep 17 19:20:04 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.732s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:20:04 devstack cinder-volume[75417]: DEBUG cinder.manager [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Notifying Schedulers of capabilities ... {{(pid=75417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:20:56 devstack cinder-volume[75417]: DEBUG oslo_service.periodic_task [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75417) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:20:56 devstack cinder-volume[75417]: DEBUG cinder.volume.drivers.lvm [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Updating volume stats {{(pid=75417) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 19:20:56 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:20:56 devstack sudo[82679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 19:20:56 devstack sudo[82679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:20:59 devstack sudo[82679]: pam_unix(sudo:session): session closed for user root
Sep 17 19:20:59 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.009s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:20:59 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:20:59 devstack sudo[82718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:20:59 devstack sudo[82718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:21:02 devstack sudo[82718]: pam_unix(sudo:session): session closed for user root
Sep 17 19:21:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.690s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:21:02 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:21:02 devstack sudo[82761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 19:21:02 devstack sudo[82761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:21:04 devstack sudo[82761]: pam_unix(sudo:session): session closed for user root
Sep 17 19:21:04 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.384s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:21:04 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:21:04 devstack sudo[82795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 19:21:04 devstack sudo[82795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:21:05 devstack cinder-volume[75319]: INFO oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Caught SIGTERM, stopping children
Sep 17 19:21:05 devstack cinder-volume[75319]: DEBUG oslo_concurrency.lockutils [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Acquiring lock "singleton_lock" {{(pid=75319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 19:21:05 devstack cinder-volume[75319]: DEBUG oslo_concurrency.lockutils [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Acquired lock "singleton_lock" {{(pid=75319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 19:21:05 devstack cinder-volume[75319]: DEBUG oslo_concurrency.lockutils [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Releasing lock "singleton_lock" {{(pid=75319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 19:21:05 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Stop services. {{(pid=75319) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 17 19:21:05 devstack cinder-volume[75319]: DEBUG oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Killing children. {{(pid=75319) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 17 19:21:05 devstack cinder-volume[75319]: INFO oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Waiting on 1 children to exit
Sep 17 19:21:08 devstack sudo[82795]: pam_unix(sudo:session): session closed for user root
Sep 17 19:21:08 devstack cinder-volume[75417]: DEBUG oslo_concurrency.processutils [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 4.086s {{(pid=75417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:21:08 devstack cinder-volume[75417]: DEBUG cinder.manager [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Notifying Schedulers of capabilities ... {{(pid=75417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Unable to connect to AMQP server on 192.168.122.179:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task [None req-9f8e8e8a-c1fd-4ff3-b30f-893d36a85fff None None] Error during VolumeManager.publish_service_capabilities: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.179:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1173, in ensure
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     ret, channel = autoretry_method()
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 556, in _ensured
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     return fun(*args, **kwargs)
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 639, in __call__
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     return fun(*args, channel=channels[0], **kwargs), channels[0]
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in execute_method
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     method()
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1624, in _publish
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     self._producer.publish(
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     return _publish(
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     return channel.basic_publish(
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     self.connection.drain_events(timeout=timeout)
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     while not self.blocking_read(timeout):
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     return self.on_inbound_frame(frame)
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     callback(channel, method_sig, buf, None)
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     return self.channels[channel_id].dispatch_method(
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     listener(*args)
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close
Sep 17 19:21:08 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     raise error_for_code(
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task 
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task 
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     task(self, context)
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/volume/manager.py", line 2873, in publish_service_capabilities
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     self._publish_service_capabilities(context)
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     self.scheduler_rpcapi.update_service_capabilities(
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     self.transport._send(self.target, msg_ctxt, msg,
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     conn.fanout_send(target.topic, msg, retry=retry)
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1743, in fanout_send
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _ensure_publishing
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     self.ensure(method, retry=retry, error_callback=_error_callback)
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1195, in ensure
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task     raise exceptions.MessageDeliveryFailure(msg)
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.179:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 17 19:21:09 devstack cinder-volume[75417]: ERROR oslo_service.periodic_task 
Sep 17 19:21:09 devstack cinder-volume[75417]: DEBUG oslo_concurrency.lockutils [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Acquiring lock "singleton_lock" {{(pid=75417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 19:21:09 devstack cinder-volume[75417]: DEBUG oslo_concurrency.lockutils [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Acquired lock "singleton_lock" {{(pid=75417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 19:21:09 devstack cinder-volume[75417]: DEBUG oslo_concurrency.lockutils [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Releasing lock "singleton_lock" {{(pid=75417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 19:21:09 devstack cinder-volume[75417]: WARNING amqp [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 17 19:21:09 devstack cinder-volume[75417]: WARNING amqp [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 17 19:21:09 devstack cinder-volume[75319]: INFO oslo_service.backend._eventlet.service [None req-0cc7c4b0-9836-4fe0-ae87-53e94549c56c None None] Child 75417 exited with status 0
Sep 17 19:21:26 devstack cinder-volume[82861]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82861) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 19:21:26 devstack cinder-volume[82861]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82861) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 19:21:26 devstack cinder-volume[82861]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82861) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 19:21:29 devstack cinder-volume[82861]: INFO dbcounter [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Registered counter for database cinder
Sep 17 19:21:29 devstack cinder-volume[82861]: DEBUG oslo_db.sqlalchemy.engines [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:21:30 devstack cinder-volume[82861]: DEBUG dbcounter [-] [82861] Writer thread running {{(pid=82861) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 19:21:30 devstack cinder-volume[82861]: INFO cinder.rpc [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 17 19:21:30 devstack cinder-volume[82861]: INFO cinder.rpc [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 17 19:21:30 devstack cinder-volume[82861]: DEBUG oslo_db.sqlalchemy.engines [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:21:30 devstack cinder-volume[82861]: INFO cinder.volume.manager [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Determined volume DB was empty at startup.
Sep 17 19:21:30 devstack cinder-volume[82861]: DEBUG cinder.volume.manager [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82861) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 17 19:21:30 devstack cinder-volume[82861]: INFO cinder.volume.manager [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 17 19:21:30 devstack cinder-volume[82861]: WARNING stevedore.named [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 19:21:30 devstack cinder-volume[82861]: WARNING castellan.key_manager [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 19:21:30 devstack cinder-volume[82861]: WARNING cinder.keymgr.conf_key_mgr [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 19:21:30 devstack cinder-volume[82861]: INFO cinder.volume.manager [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 17 19:21:30 devstack cinder-volume[82861]: DEBUG oslo_db.sqlalchemy.engines [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:21:30 devstack cinder-volume[82861]: INFO oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Starting 1 workers
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Started child 83122 {{(pid=82861) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 17 19:21:31 devstack cinder-volume[83122]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Full set of CONF: {{(pid=82861) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] ******************************************************************************** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Configuration options gathered from: {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] ================================================================================ {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] allow_availability_zone_fallback = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] allow_compression_on_image_upload = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] allowed_direct_url_schemes     = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] api_rate_limit                 = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] auth_strategy                  = keystone {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_availability_zone      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_host                   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_name                   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_stats_polling_interval = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backup_api_class               = cinder.backup.api.API {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backup_name_template           = backup-%s {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backup_use_same_host           = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backup_use_temp_snapshot       = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] chap_password                  = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] chap_username                  =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_internal_tenant_project_id = d46eeb6cf6214c7e9972c5e0ec6bc76a {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_internal_tenant_user_id = 4f74fab4eec04afbb4745a371c15bc78 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cluster                        = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] compression_format             = gzip {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] config_dir                     = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] config_source                  = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] control_exchange               = openstack {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] debug                          = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] default_availability_zone      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] default_group_type             = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] default_volume_type            = QuobyteHD {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] driver_client_cert             = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] driver_client_cert_key         = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] driver_data_namespace          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] driver_ssl_cert_path           = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] driver_ssl_cert_verify         = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] driver_use_ssl                 = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] enable_new_services            = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] enable_unsupported_driver      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] enforce_multipath_for_image_xfer = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] filter_function                = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_api_insecure            = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_api_servers             = ['http://192.168.122.179/image'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_api_ssl_compression     = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_ca_certificates_file    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_certfile                = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_keyfile                 = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_num_retries             = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance_request_timeout         = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] goodness_function              = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] graceful_shutdown_timeout      = 5 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] group_api_class                = cinder.group.api.API {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] host                           = devstack {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_compress_on_upload       = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_conversion_address_space_limit = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_conversion_cpu_limit     = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_conversion_disable       = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_upload_use_cinder_backend = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_upload_use_internal_tenant = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_volume_cache_enabled     = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_volume_cache_max_count   = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] image_volume_cache_max_size_gb = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] init_host_max_objects_retrieval = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] iscsi_iotype                   = fileio {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] iscsi_target_flags             =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] iscsi_write_cache              = on {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] iser_helper                    = tgtadm {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] iser_ip_address                = 192.168.122.179 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] iser_port                      = 3260 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_color                      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_config_append              = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_dir                        = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_file                       = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_options                    = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_rotate_interval            = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_rotate_interval_type       = days {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] log_rotation_type              = none {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] max_age                        = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] max_logfile_count              = 30 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] max_logfile_size_mb            = 200 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] max_over_subscription_ratio    = 20.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] message_reap_interval          = 86400 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] message_ttl                    = 2592000 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] migration_create_volume_timeout_secs = 300 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] monkey_patch                   = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] monkey_patch_modules           = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] my_ip                          = 192.168.122.179 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] no_snapshot_gb_quota           = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] num_iser_scan_tries            = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] num_shell_tries                = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] num_volume_device_scan_tries   = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] nvmeof_conn_info_version       = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] nvmet_ns_id                    = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] nvmet_port_id                  = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] osapi_max_limit                = 1000 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] osapi_volume_ext_list          = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] osapi_volume_listen_port       = 8776 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] osapi_volume_use_ssl           = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] osapi_volume_workers           = 2 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] per_volume_size_limit          = -1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] periodic_fuzzy_delay           = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] periodic_interval              = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] public_endpoint                = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] publish_errors                 = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] quota_backup_gigabytes         = 1000 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] quota_backups                  = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] quota_gigabytes                = 1000 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] quota_groups                   = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] quota_snapshots                = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] quota_volumes                  = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] rate_limit_burst               = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] rate_limit_except_level        = CRITICAL {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] rate_limit_interval            = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] reinit_driver_count            = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] replication_device             = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] report_discard_supported       = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] report_interval                = 120 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] reservation_clean_interval     = 86400 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] reservation_expire             = 86400 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] reserved_image_namespaces      = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] reserved_percentage            = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] rpc_response_timeout           = 120 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] run_external_periodic_tasks    = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] scst_target_driver             = iscsi {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] scst_target_iqn_name           = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_down_time              = 720 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] shell_completion               = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] snapshot_name_template         = snapshot-%s {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] split_loggers                  = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] state_path                     = /opt/stack/data/cinder {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] storage_availability_zone      = nova {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] storage_protocol               = iSCSI {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] syslog_log_facility            = LOG_USER {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] target_helper                  = lioadm {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] target_ip_address              = 192.168.122.179 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] target_port                    = 3260 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] target_protocol                = iscsi {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] target_secondary_ip_addresses  = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] trace_flags                    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] transport_url                  = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] until_refresh                  = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] use_chap_auth                  = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] use_default_quota_class        = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] use_journal                    = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] use_json                       = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] use_multipath_for_image_xfer   = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] use_stderr                     = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] use_syslog                     = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] verify_glance_signatures       = enabled {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_api_class               = cinder.volume.api.API {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_backend_name            = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_clear                   = zero {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_clear_ionice            = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_clear_size              = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_copy_bps_limit          = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_dd_blocksize            = 1M {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_name_template           = volume-%s {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_service_inithost_offload = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volume_usage_audit_period      = month {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] watch_log_file                 = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] zoning_mode                    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 19:21:31 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_concurrency.disable_process_locking = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83122) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.admin_password = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.admin_token = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.admin_user  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.auth_protocol = https {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.auth_section = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.auth_type   = password {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.auth_uri    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.auth_version = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.cache       = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.certfile    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.identity_uri = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.include_service_catalog = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.insecure    = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.interface   = public {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.keyfile     = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_password =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcache_username =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.region_name = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.service_type = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.backend                  = dogpile.cache.null {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.backend_argument         = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.backend_expiration_time  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.config_prefix            = cache.oslo {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.dead_timeout             = 60.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.debug_cache_backend      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.enable_retry_client      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.enable_socket_keepalive  = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.enabled                  = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.enforce_fips_mode        = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.expiration_time          = 600 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.hashclient_retry_attempts = 2 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_dead_retry      = 300 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_password        = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_sasl_enabled    = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.memcache_username        = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.proxies                  = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.redis_db                 = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.redis_password           = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:31 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.redis_server             = localhost:6379 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.redis_socket_timeout     = 1.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.redis_username           = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.retry_attempts           = 2 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.retry_delay              = 0.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.socket_keepalive_count   = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.socket_keepalive_idle    = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.socket_keepalive_interval = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.tls_allowed_ciphers      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.tls_cafile               = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.tls_certfile             = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.tls_enabled              = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cache.tls_keyfile              = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] coordination.backend_url       = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.asyncio_connection    = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.asyncio_slave_connection = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.backend               = sqlalchemy {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.connection            = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.connection_debug      = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.connection_parameters =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.connection_recycle_time = 3600 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.connection_trace      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.db_inc_retry_interval = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.db_max_retries        = 20 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.db_max_retry_interval = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.db_retry_interval     = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.max_overflow          = 50 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.max_pool_size         = 5 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.max_retries           = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.mysql_wsrep_sync_wait = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.pool_timeout          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.retry_interval        = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.slave_connection      = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.sqlite_synchronous    = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] database.use_db_reconnect      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.connection_string     = messaging:// {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.enabled               = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.es_doc_type           = notification {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.es_scroll_size        = 10000 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.es_scroll_time        = 2m {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.filter_error_trace    = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.hmac_keys             = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.sentinel_service_name = mymaster {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.socket_timeout        = 0.1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.trace_requests        = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler.trace_sqlalchemy      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler_jaeger.process_tags   = {} {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler_jaeger.service_name_prefix = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] profiler_otlp.service_name_prefix = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.enforce_new_defaults = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: WARNING oslo_config.cfg [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.enforce_scope      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.policy_default_rule = default {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] privsep_osbrick.group          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] privsep_osbrick.helper_command = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] privsep_osbrick.user           = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_sys_admin.group         = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_sys_admin.helper_command = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] cinder_sys_admin.user          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.auth_section      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.auth_type         = password {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.certfile          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.collect_timing    = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.insecure          = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.keyfile           = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.send_service_user_token = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.split_loggers     = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] service_user.timeout           = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.auth_section            = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.auth_type               = password {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.certfile                = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.collect_timing          = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.insecure                = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.keyfile                 = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.split_loggers           = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] glance.timeout                 = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.backend_availability_zone = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.chap_password = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.chap_username =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.driver_client_cert = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.driver_client_cert_key = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.driver_data_namespace = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.driver_use_ssl = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.extra_capabilities = {} {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.filter_function = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.goodness_function = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.iscsi_target_flags =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.iscsi_write_cache = on {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.iser_ip_address = 192.168.122.179 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.iser_port     = 3260 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_host      =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_login     = admin {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_mount_options = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_password  = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_private_key =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_share_path =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.num_shell_tries = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.quobyte_volume_url = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.replication_device = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.report_discard_supported = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.reserved_percentage = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.target_helper = tgtadm {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.target_ip_address = 192.168.122.179 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.target_port   = 3260 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.target_protocol = iscsi {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.trace_flags   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.unique_fqdn_network = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.use_chap_auth = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volume_backend_name = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volume_clear  = zero {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volume_clear_ionice = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volume_clear_size = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_reports.file_event_handler = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_reports.log_dir           = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.backend_availability_zone = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.backend_host         = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.chap_password        = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.chap_username        = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.driver_client_cert   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.driver_data_namespace = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.extra_capabilities   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.filter_function      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.goodness_function    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.iscsi_iotype         = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.iser_helper          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.iser_ip_address      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.iser_port            = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_host             = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_login            = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_mount_options    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_password         = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_private_key      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_share_path       = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.num_shell_tries      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83122) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 17 19:21:32 devstack cinder-volume[83122]: INFO cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.replication_device   = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.report_discard_supported = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.reserved_percentage  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.scst_target_driver   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Running cmd (subprocess): mount.quobyte {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.storage_protocol     = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.target_helper        = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.target_ip_address    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.target_port          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.target_prefix        = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.target_protocol      = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.trace_flags          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.use_chap_auth        = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volume_clear         = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volume_clear_size    = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] QuobyteHD.volumes_dir          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_notifications.driver = [] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_notifications.retry = -1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] key_manager.fixed_key          = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.barbican_api_version  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.barbican_endpoint     = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.barbican_endpoint_type = public {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.barbican_region_name  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.cafile                = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.certfile              = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.collect_timing        = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.insecure              = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.keyfile               = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.number_of_retries     = 60 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.retry_delay           = 1 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.send_service_user_token = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.split_loggers         = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.timeout               = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.verify_ssl            = True {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican.verify_ssl_path       = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.auth_section = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.auth_type = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.cafile   = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.certfile = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.collect_timing = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.insecure = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.keyfile  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.split_loggers = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] barbican_service_user.timeout  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.approle_role_id          = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.approle_secret_id        = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.kv_mountpoint            = secret {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.kv_path                  = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.kv_version               = 2 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.namespace                = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.root_token_id            = **** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.ssl_ca_crt_file          = None {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.timeout                  = 60.0 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.use_ssl                  = False {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 19:21:32 devstack cinder-volume[82861]: DEBUG oslo_service.backend._eventlet.service [None req-3b9d6257-9d42-4491-9260-b1f510b52a80 None None] ******************************************************************************** {{(pid=82861) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 17 19:21:32 devstack quobyte-client[83129]: Reading configuration file: /etc/quobyte/client.cfg
Sep 17 19:21:32 devstack quobyte-client[83129]: Invalid parameters found, error: missing mount point.
Sep 17 19:21:32 devstack quobyte-client[83129]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 17 19:21:32 devstack quobyte-client[83129]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 17 19:21:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] CMD "mount.quobyte" returned: 1 in 0.504s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:21:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:21:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:21:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:21:32 devstack cinder-volume[83122]: INFO cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Mounting volume: 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b ...
Sep 17 19:21:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa -c /etc/quobyte/client-cinder.cfg {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:21:33 devstack quobyte-client[83136]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 17 19:21:33 devstack quobyte-client[83136]: Reading configuration file: /etc/quobyte/client.cfg
Sep 17 19:21:33 devstack quobyte-client[83136]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa' to display the log.
Sep 17 19:21:33 devstack quobyte-client[83143]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 17 19:21:33 devstack quobyte-client[83143]: mount.quobyte 3.25 (4fbbd59204)
Sep 17 19:21:33 devstack quobyte-client[83143]: Client UUID: wQbCRY2h-X5pZ-99UY-A6pv-DmqJS8wdOezO
Sep 17 19:21:33 devstack quobyte-client[83143]: Registry: osci01.corp.quobyte.com:7861
Sep 17 19:21:33 devstack quobyte-client[83143]: Volume: cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:21:33 devstack quobyte-client[83143]: FUSE version: 316
Sep 17 19:21:33 devstack quobyte-client[83143]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 17 19:21:33 devstack quobyte-client[83143]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 17 19:21:33 devstack quobyte-client[83143]: Setting total object cache size to 3352297472 bytes
Sep 17 19:21:33 devstack quobyte-client[83143]: Using FUSE low-level API
Sep 17 19:21:33 devstack quobyte-client[83143]: Caching of uid/gid to user/group name mappings is enabled
Sep 17 19:21:33 devstack quobyte-client[83143]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 17 19:21:33 devstack quobyte-client[83143]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 17 19:21:33 devstack quobyte-client[83143]: HTTP server started on port 55000
Sep 17 19:21:33 devstack quobyte-client[83143]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 17 19:21:33 devstack quobyte-client[83143]: Mount point /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa established
Sep 17 19:21:33 devstack quobyte-client[83143]: TimeSync is running and remote sync every 60 seconds
Sep 17 19:21:33 devstack quobyte-client[83143]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 19:21:33 devstack quobyte-client[83143]: Ignored time synchronization message because time source took too long to respond (67 ms)
Sep 17 19:21:33 devstack quobyte-client[83143]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 19:21:33 devstack quobyte-client[83143]: Opening volume cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b (cf89d26d-19af-4edf-9b79-baf4807fabac)
Sep 17 19:21:33 devstack quobyte-client[83143]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 17 19:21:33 devstack quobyte-client[83143]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 19:21:34 devstack quobyte-client[83143]: Failed to invalidate inode: 38: Function not implemented
Sep 17 19:21:34 devstack quobyte-client[83143]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 19:21:34 devstack quobyte-client[83143]: Automatic minidump upload enabled by global system configuration
Sep 17 19:21:34 devstack quobyte-client[83143]: Announcing HTTP status server address 172.24.4.1
Sep 17 19:21:34 devstack quobyte-client[83143]: Registered as service (uuid wQbCRY2h-X5pZ-99UY-A6pv-DmqJS8wdOezO)
Sep 17 19:21:34 devstack quobyte-client[83143]: Quobyte Client running as pid 83143
Sep 17 19:21:34 devstack quobyte-client[83143]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 17 19:21:34 devstack quobyte-client[83143]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.101s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:21:34 devstack cinder-volume[83122]: INFO cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Mounting volume: 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b succeeded
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.195s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:21:34 devstack quobyte-client[83143]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.143s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:21:34 devstack cinder-volume[83122]: INFO cinder.volume.driver [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Driver hasn't implemented _init_vendor_properties()
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG cinder.volume.driver [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83122) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_db.sqlalchemy.engines [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writer thread running {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG cinder.db.sqlalchemy.api [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Building query based on filter {{(pid=83122) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83122) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 17 19:21:34 devstack cinder-volume[83122]: INFO cinder.keymgr.migration [None req-697c88c1-635f-4d19-996a-bd1203deb051 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:21:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.095s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:21:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Driver initialization completed successfully.
Sep 17 19:21:35 devstack cinder-volume[83122]: INFO cinder.manager [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Initiating service 3 cleanup
Sep 17 19:21:35 devstack cinder-volume[83122]: INFO cinder.manager [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Service 3 cleanup completed.
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG cinder.service [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Creating RPC server for service cinder-volume {{(pid=83122) start /opt/stack/cinder/cinder/service.py:239}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG cinder.service [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83122) start /opt/stack/cinder/cinder/service.py:245}}
Sep 17 19:21:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 17 19:21:35 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:21:35 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:21:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.115s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:21:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-960f49e8-ed5f-4978-a135-e0a098d86aa0 None None] Driver post RPC initialization completed successfully.
Sep 17 19:21:36 devstack quobyte-client[83143]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 19:21:40 devstack cinder-volume[82861]: DEBUG dbcounter [-] [82861] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82861) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:21:45 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:21:45 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:22:52 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:22:52 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:22:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Flow 'volume_create_manager' (d1e2ce24-a226-4fc6-b257-45b0476a27c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:22:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c832de-aef1-4f5d-9600-2fbfb470e4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:22:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c832de-aef1-4f5d-9600-2fbfb470e4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1370843706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e709ed88-3eec-483c-91b0-20d3b4846818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0bf7170b98480eab8cd607b200cb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:22:52Z,use_quota=True,user_id='b91b32389dd84b53a63e0579e8bc0a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:22:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04732de0-7ba9-4edc-a44d-d62459404924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04732de0-7ba9-4edc-a44d-d62459404924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bd10c9-04ef-42d1-b1d7-8d5e8bf99f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bd10c9-04ef-42d1-b1d7-8d5e8bf99f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e709ed88-3eec-483c-91b0-20d3b4846818', 'volume_name': 'volume-e709ed88-3eec-483c-91b0-20d3b4846818', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad0f2f8-388f-4d31-94f7-0277835ee24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad0f2f8-388f-4d31-94f7-0277835ee24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa30560f-3b77-46bd-a6ec-0020c43807ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:22:53 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Volume e709ed88-3eec-483c-91b0-20d3b4846818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e709ed88-3eec-483c-91b0-20d3b4846818', 'volume_size': 1}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1370843706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e709ed88-3eec-483c-91b0-20d3b4846818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0bf7170b98480eab8cd607b200cb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:22:52Z,use_quota=True,user_id='b91b32389dd84b53a63e0579e8bc0a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Creating volume e709ed88-3eec-483c-91b0-20d3b4846818 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:22:53 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:22:53 devstack quobyte-client[83143]: System call of process 83398 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.269s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:22:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:22:53 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=2, name=volume-e709ed88-3eec-483c-91b0-20d3b4846818, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818 1073741824" returned: 0 in 1.181s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818" returned: 0 in 0.074s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] <== create_volume: return (1304ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa30560f-3b77-46bd-a6ec-0020c43807ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e709ed88-3eec-483c-91b0-20d3b4846818', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7a0f08-6f17-47d2-949d-58a39f23256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:22:54 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Volume volume-e709ed88-3eec-483c-91b0-20d3b4846818 (e709ed88-3eec-483c-91b0-20d3b4846818): created successfully
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7a0f08-6f17-47d2-949d-58a39f23256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:22:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Flow 'volume_create_manager' (d1e2ce24-a226-4fc6-b257-45b0476a27c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:22:54 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-533a3dfc-ba63-4aba-9f72-861eac93c8a6 tempest-VolumesAssistedSnapshotsTest-271321061 None] Created volume successfully.
Sep 17 19:23:04 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:23:04 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:23:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:23:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:23:46 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:23:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Flow 'volume_create_manager' (7b40ab5d-ce2a-452b-8181-74fcf8dcb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:23:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d127a4-1623-45a5-930b-76ebe2be4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d127a4-1623-45a5-930b-76ebe2be4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1689415121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df65d45-acc0-4674-830c-74462b7ff109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc054adbe26245a4befd3b350939e93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:23:46Z,use_quota=True,user_id='eafff3d15fb54858977a1edb6cfff64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7323c25-ebe8-40ef-a42c-4cf73b1e5459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7323c25-ebe8-40ef-a42c-4cf73b1e5459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b972297-b416-490c-877d-2f262ff0ddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b972297-b416-490c-877d-2f262ff0ddad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df65d45-acc0-4674-830c-74462b7ff109', 'volume_name': 'volume-8df65d45-acc0-4674-830c-74462b7ff109', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe4cb97-ea1d-4146-8fc1-e1a6ad71c396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe4cb97-ea1d-4146-8fc1-e1a6ad71c396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98a8db4-7777-4023-b910-15dc58c6d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:23:47 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Volume 8df65d45-acc0-4674-830c-74462b7ff109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df65d45-acc0-4674-830c-74462b7ff109', 'volume_size': 1}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1689415121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df65d45-acc0-4674-830c-74462b7ff109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc054adbe26245a4befd3b350939e93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:23:46Z,use_quota=True,user_id='eafff3d15fb54858977a1edb6cfff64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Creating volume 8df65d45-acc0-4674-830c-74462b7ff109 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:23:47 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:23:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df65d45-acc0-4674-830c-74462b7ff109 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:23:47 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=3, name=volume-8df65d45-acc0-4674-830c-74462b7ff109, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:23:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df65d45-acc0-4674-830c-74462b7ff109 1073741824" returned: 0 in 1.329s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:23:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df65d45-acc0-4674-830c-74462b7ff109 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:23:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df65d45-acc0-4674-830c-74462b7ff109" returned: 0 in 0.248s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:23:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] <== create_volume: return (1811ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:23:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:23:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98a8db4-7777-4023-b910-15dc58c6d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df65d45-acc0-4674-830c-74462b7ff109', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:23:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c6d313-cc4c-438e-a9f3-e9b5cc73d09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:23:49 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Volume volume-8df65d45-acc0-4674-830c-74462b7ff109 (8df65d45-acc0-4674-830c-74462b7ff109): created successfully
Sep 17 19:23:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c6d313-cc4c-438e-a9f3-e9b5cc73d09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:23:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Flow 'volume_create_manager' (7b40ab5d-ce2a-452b-8181-74fcf8dcb881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:23:50 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a2c17559-4058-4c16-a6dd-aeddf61f76c8 tempest-VolumesAdminNegativeTest-840664405 None] Created volume successfully.
Sep 17 19:23:51 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Acquiring lock "cinder-8df65d45-acc0-4674-830c-74462b7ff109-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:23:51 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Lock "cinder-8df65d45-acc0-4674-830c-74462b7ff109-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:23:52 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:23:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Acquiring lock "cinder-quobyte-8df65d45-acc0-4674-830c-74462b7ff109" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:23:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Lock "cinder-quobyte-8df65d45-acc0-4674-830c-74462b7ff109" acquired by "delete_volume" :: waited 0.063s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:23:52 devstack cinder-volume[83122]: INFO oslo.privsep.daemon [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp19239kqc/privsep.sock']
Sep 17 19:23:52 devstack sudo[84088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp19239kqc/privsep.sock
Sep 17 19:23:52 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.451s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:23:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:24:02 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:24:02 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:24:11 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root
Sep 17 19:24:11 devstack cinder-volume[83122]: INFO oslo.privsep.daemon [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Spawned new privsep daemon via rootwrap
Sep 17 19:24:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Accepted privsep connection to /tmp/tmp19239kqc/privsep.sock {{(pid=83122) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 17 19:24:11 devstack cinder-volume[83122]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 17 19:24:11 devstack cinder-volume[83122]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 17 19:24:11 devstack cinder-volume[83122]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 17 19:24:11 devstack cinder-volume[83122]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84128
Sep 17 19:24:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13b8fc9-6233-440e-91c6-bfb519d06f84]: (2,) {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:24:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a89f3-fbeb-4e7d-bcc5-bd7fa185baff]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:24:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df65d45-acc0-4674-830c-74462b7ff109 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:24:13 devstack quobyte-client[83143]: System call of process 84165 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:24:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df65d45-acc0-4674-830c-74462b7ff109" returned: 0 in 1.481s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:24:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df65d45-acc0-4674-830c-74462b7ff109 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:24:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df65d45-acc0-4674-830c-74462b7ff109" returned: 0 in 0.259s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:24:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Lock "cinder-quobyte-8df65d45-acc0-4674-830c-74462b7ff109" released by "delete_volume" :: held 21.619s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:24:14 devstack cinder-volume[83122]: WARNING cinder.quota [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:24:14 devstack cinder-volume[83122]: WARNING cinder.quota [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:24:15 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Created reservations ['56ab0d3b-514b-4a9d-a9b5-2172df229524', '8dc5caf2-fb52-4c36-a36a-dd04c8085ed1', 'e6590492-b65c-4fa2-893c-7b20fe0bbcba', 'fc06be88-d57f-4ea0-a6b9-d8a2a2f7600c'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:24:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:24:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:24:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:24:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:24:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:24:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:24:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.376s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:24:16 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:24:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Deleted volume successfully.
Sep 17 19:24:16 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4cacb8ce-4372-4cc2-9508-2f6b51b25db5 tempest-VolumesAdminNegativeTest-840664405 None] Lock "cinder-8df65d45-acc0-4674-830c-74462b7ff109-delete_volume" released by "delete_volume" :: held 24.552s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:24:25 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:24:26 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.106s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:24:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:25:14 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Flow 'volume_create_manager' (a6af7d74-b6eb-461e-a0ca-272483ff139e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d6686a-60f2-44c3-ac80-380ff01d989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d6686a-60f2-44c3-ac80-380ff01d989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1243244013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b404ee5-88bb-46e9-8765-3f0b2fbec4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e26023e3bd4afabac29aa6de036a11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:25:14Z,use_quota=True,user_id='430a841420c5493fa9059ab0d719a96c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b099c038-bc73-469c-ad7d-2a46308c4c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b099c038-bc73-469c-ad7d-2a46308c4c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c130142-4db2-4c62-ac24-f743d4db1d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c130142-4db2-4c62-ac24-f743d4db1d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b404ee5-88bb-46e9-8765-3f0b2fbec4bb', 'volume_name': 'volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf1b8b4-32f7-41cf-a643-0108c19d68ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf1b8b4-32f7-41cf-a643-0108c19d68ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0125e79-1d98-41ff-b37a-3c1159ee83ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:25:14 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Volume 6b404ee5-88bb-46e9-8765-3f0b2fbec4bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb', 'volume_size': 1}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1243244013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b404ee5-88bb-46e9-8765-3f0b2fbec4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e26023e3bd4afabac29aa6de036a11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:25:14Z,use_quota=True,user_id='430a841420c5493fa9059ab0d719a96c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Creating volume 6b404ee5-88bb-46e9-8765-3f0b2fbec4bb {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:25:14 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:25:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:25:15 devstack quobyte-client[83143]: System call of process 84558 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:25:15 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=4, name=volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:25:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb 1073741824" returned: 0 in 0.632s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:25:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:25:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb" returned: 0 in 0.230s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:25:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] <== create_volume: return (1009ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:25:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:25:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0125e79-1d98-41ff-b37a-3c1159ee83ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:25:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0896e5-2aff-498b-baf2-644a0b936ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:25:16 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Volume volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb (6b404ee5-88bb-46e9-8765-3f0b2fbec4bb): created successfully
Sep 17 19:25:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0896e5-2aff-498b-baf2-644a0b936ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:25:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Flow 'volume_create_manager' (a6af7d74-b6eb-461e-a0ca-272483ff139e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:25:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-70387d66-90d2-431b-8a7c-23e06b23e705 tempest-AttachSCSIVolumeTestJSON-534327739 None] Created volume successfully.
Sep 17 19:25:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-392e5278-e050-485f-bb7d-2fb70dc2cb27 req-5e2c0614-3434-4a21-872e-8c6b8126aede tempest-VolumesAssistedSnapshotsTest-271321061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:25:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-392e5278-e050-485f-bb7d-2fb70dc2cb27 req-5e2c0614-3434-4a21-872e-8c6b8126aede tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:25:18 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fdbb9d-bbef-4514-96d2-05b9e9376a71]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:25:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-392e5278-e050-485f-bb7d-2fb70dc2cb27 req-5e2c0614-3434-4a21-872e-8c6b8126aede tempest-VolumesAssistedSnapshotsTest-271321061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:25:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-392e5278-e050-485f-bb7d-2fb70dc2cb27 req-5e2c0614-3434-4a21-872e-8c6b8126aede tempest-VolumesAssistedSnapshotsTest-271321061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818" returned: 0 in 0.502s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:25:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-392e5278-e050-485f-bb7d-2fb70dc2cb27 req-5e2c0614-3434-4a21-872e-8c6b8126aede tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.561s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:25:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-392e5278-e050-485f-bb7d-2fb70dc2cb27 req-5e2c0614-3434-4a21-872e-8c6b8126aede tempest-VolumesAssistedSnapshotsTest-271321061 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-e709ed88-3eec-483c-91b0-20d3b4846818', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c2b1ceb-97f0-4af9-ae63-e72604831408', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:25:19 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-392e5278-e050-485f-bb7d-2fb70dc2cb27 req-5e2c0614-3434-4a21-872e-8c6b8126aede tempest-VolumesAssistedSnapshotsTest-271321061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:25:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-392e5278-e050-485f-bb7d-2fb70dc2cb27 req-5e2c0614-3434-4a21-872e-8c6b8126aede tempest-VolumesAssistedSnapshotsTest-271321061 None] attachment_update completed successfully.
Sep 17 19:25:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-05ffa5ad-017e-40b7-b152-db061feee534 req-8abe5d8b-1e26-43be-8d75-63fb3e5a65b4 tempest-AttachSCSIVolumeTestJSON-534327739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:25:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-05ffa5ad-017e-40b7-b152-db061feee534 req-8abe5d8b-1e26-43be-8d75-63fb3e5a65b4 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:25:22 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c38469c-f5b9-46b5-9c0a-07a5595e8818]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:25:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-05ffa5ad-017e-40b7-b152-db061feee534 req-8abe5d8b-1e26-43be-8d75-63fb3e5a65b4 tempest-AttachSCSIVolumeTestJSON-534327739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:25:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-05ffa5ad-017e-40b7-b152-db061feee534 req-8abe5d8b-1e26-43be-8d75-63fb3e5a65b4 tempest-AttachSCSIVolumeTestJSON-534327739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb" returned: 0 in 0.575s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:25:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-05ffa5ad-017e-40b7-b152-db061feee534 req-8abe5d8b-1e26-43be-8d75-63fb3e5a65b4 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.632s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:25:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-05ffa5ad-017e-40b7-b152-db061feee534 req-8abe5d8b-1e26-43be-8d75-63fb3e5a65b4 tempest-AttachSCSIVolumeTestJSON-534327739 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '186d01d9-82d7-4466-bd47-2187f2dc4bba', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:25:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-05ffa5ad-017e-40b7-b152-db061feee534 req-8abe5d8b-1e26-43be-8d75-63fb3e5a65b4 tempest-AttachSCSIVolumeTestJSON-534327739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:25:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-05ffa5ad-017e-40b7-b152-db061feee534 req-8abe5d8b-1e26-43be-8d75-63fb3e5a65b4 tempest-AttachSCSIVolumeTestJSON-534327739 None] attachment_update completed successfully.
Sep 17 19:25:33 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=11 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:25:33 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:25:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:25:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:25:52 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-f01a77c1-ccb6-4cd2-bb0b-2890c2dbd60b req-e6be0a9f-70c7-4cee-9805-ea59174c17ee tempest-VolumesAssistedSnapshotsTest-271321061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:25:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-f01a77c1-ccb6-4cd2-bb0b-2890c2dbd60b req-e6be0a9f-70c7-4cee-9805-ea59174c17ee tempest-VolumesAssistedSnapshotsTest-271321061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:25:53 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-f01a77c1-ccb6-4cd2-bb0b-2890c2dbd60b req-e6be0a9f-70c7-4cee-9805-ea59174c17ee tempest-VolumesAssistedSnapshotsTest-271321061 None] Terminate volume connection completed successfully.
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-f01a77c1-ccb6-4cd2-bb0b-2890c2dbd60b req-e6be0a9f-70c7-4cee-9805-ea59174c17ee tempest-VolumesAssistedSnapshotsTest-271321061 None] Deleting attachment 8c2b1ceb-97f0-4af9-ae63-e72604831408. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.084s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:25:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-d9b03032-de74-4a9e-9fa9-96a4d412da91 req-196642d6-f029-43a5-857c-89fd4aeab66e tempest-AttachSCSIVolumeTestJSON-534327739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:25:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-d9b03032-de74-4a9e-9fa9-96a4d412da91 req-196642d6-f029-43a5-857c-89fd4aeab66e tempest-AttachSCSIVolumeTestJSON-534327739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:25:53 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-d9b03032-de74-4a9e-9fa9-96a4d412da91 req-196642d6-f029-43a5-857c-89fd4aeab66e tempest-AttachSCSIVolumeTestJSON-534327739 None] Terminate volume connection completed successfully.
Sep 17 19:25:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-d9b03032-de74-4a9e-9fa9-96a4d412da91 req-196642d6-f029-43a5-857c-89fd4aeab66e tempest-AttachSCSIVolumeTestJSON-534327739 None] Deleting attachment 186d01d9-82d7-4466-bd47-2187f2dc4bba. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:25:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Acquiring lock "cinder-e709ed88-3eec-483c-91b0-20d3b4846818-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:25:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "cinder-e709ed88-3eec-483c-91b0-20d3b4846818-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:25:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:25:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Acquiring lock "cinder-quobyte-e709ed88-3eec-483c-91b0-20d3b4846818" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:25:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "cinder-quobyte-e709ed88-3eec-483c-91b0-20d3b4846818" acquired by "delete_volume" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:25:55 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191c538-9e29-40ed-9acf-51a876214bd8]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:25:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:25:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818" returned: 0 in 0.559s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:25:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e709ed88-3eec-483c-91b0-20d3b4846818" returned: 0 in 0.128s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "cinder-quobyte-e709ed88-3eec-483c-91b0-20d3b4846818" released by "delete_volume" :: held 0.856s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Created reservations ['fea4f758-481e-46fd-b456-a985bf66834f', 'b8eb594b-bbd9-43c0-a858-97d32626a9a5', '1c83dff8-fcf0-4394-aec9-8dfd36c3edfc', '4ea8d60f-4832-4c0b-8bfd-2bd013bcf3e4'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.130s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:25:56 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:25:56 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Deleted volume successfully.
Sep 17 19:25:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8938e15b-79e8-4b38-ab83-976f293ab423 tempest-VolumesAssistedSnapshotsTest-271321061 None] Lock "cinder-e709ed88-3eec-483c-91b0-20d3b4846818-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:26:06 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:26:07 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:26:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Acquiring lock "cinder-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:26:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "cinder-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:26:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:26:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Acquiring lock "cinder-quobyte-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:26:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "cinder-quobyte-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb" acquired by "delete_volume" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:26:09 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f19b0a1-2c46-410b-8c88-14f2450c9c8d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:26:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:26:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb" returned: 0 in 0.521s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:26:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:26:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb" returned: 0 in 0.093s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "cinder-quobyte-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb" released by "delete_volume" :: held 0.770s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Created reservations ['e0019135-0849-43dc-83fd-5f60f230993d', '770ca1ac-232c-48c6-b53d-44d709a1a52a', '910fdd59-a3b2-4029-a5a0-b79869122073', 'cd37c7e5-f1c0-4b97-9e9e-a05164b18c6b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.071s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:26:10 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:26:10 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Deleted volume successfully.
Sep 17 19:26:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-771d1a56-ae85-4fdc-adcb-0342d07ba569 tempest-AttachSCSIVolumeTestJSON-534327739 None] Lock "cinder-6b404ee5-88bb-46e9-8765-3f0b2fbec4bb-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:26:20 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1,cinder:INSERT=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:26:20 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:26:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:26:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:26:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:26:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:26:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:26:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:26:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.843s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:26:54 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Flow 'volume_create_manager' (0f99a312-46b7-49f0-a3b9-c48102a5cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c3be09-4a3c-48ff-9df4-114d05ce1177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c3be09-4a3c-48ff-9df4-114d05ce1177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-909497185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1e53e5-caec-4d76-be8d-011c34e5fe13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf7efabd7834a22991544f090c9929a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:26:53Z,use_quota=True,user_id='f3e32a4e52244632bd6557df0fa4752d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a6e79-ed56-4ac4-80ce-03bf24251925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a6e79-ed56-4ac4-80ce-03bf24251925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c48f4f-f423-425d-998e-36a85774185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c48f4f-f423-425d-998e-36a85774185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1e53e5-caec-4d76-be8d-011c34e5fe13', 'volume_name': 'volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fba6364-2f13-474b-b1c9-c31f9a642d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fba6364-2f13-474b-b1c9-c31f9a642d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19479905-1001-4542-b126-90414301a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:26:54 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume 9e1e53e5-caec-4d76-be8d-011c34e5fe13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13', 'volume_size': 1}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-909497185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1e53e5-caec-4d76-be8d-011c34e5fe13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf7efabd7834a22991544f090c9929a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:26:53Z,use_quota=True,user_id='f3e32a4e52244632bd6557df0fa4752d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Creating volume 9e1e53e5-caec-4d76-be8d-011c34e5fe13 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:26:54 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:26:54 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=5, name=volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13 1073741824" returned: 0 in 0.503s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:26:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:26:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13" returned: 0 in 0.139s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:26:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] <== create_volume: return (710ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:26:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:26:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19479905-1001-4542-b126-90414301a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:26:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cbceed-a6c9-4c96-8824-1c5b851df13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:26:55 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13 (9e1e53e5-caec-4d76-be8d-011c34e5fe13): created successfully
Sep 17 19:26:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cbceed-a6c9-4c96-8824-1c5b851df13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:26:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Flow 'volume_create_manager' (0f99a312-46b7-49f0-a3b9-c48102a5cd19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:26:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-bab520a8-af38-43f3-80c4-7c5032923ec6 tempest-AttachVolumeShelveTestJSON-48541388 None] Created volume successfully.
Sep 17 19:27:05 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:27:05 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:27:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Flow 'volume_create_manager' (70e54e52-4506-4373-9fad-5696b3d2ea7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26125615-4d16-4624-ae60-c27b2e306145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26125615-4d16-4624-ae60-c27b2e306145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-802001325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fe7bbd-0e90-407d-aa34-46bf03883377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e341e19ebe4c3784a135755cb617c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:27:13Z,use_quota=True,user_id='5ae69cf3ea8a4d89ab1c7df88eb9fc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2389027d-2636-4f90-998f-73a3506d5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2389027d-2636-4f90-998f-73a3506d5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7257c6-e08e-4c28-b2f0-1ddb681aa1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7257c6-e08e-4c28-b2f0-1ddb681aa1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fe7bbd-0e90-407d-aa34-46bf03883377', 'volume_name': 'volume-f9fe7bbd-0e90-407d-aa34-46bf03883377', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c942d159-86f2-4fc4-8e52-2253f072df2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c942d159-86f2-4fc4-8e52-2253f072df2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a700e960-104f-4e8b-834f-13645746d7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:12 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Volume f9fe7bbd-0e90-407d-aa34-46bf03883377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fe7bbd-0e90-407d-aa34-46bf03883377', 'volume_size': 1}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-802001325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fe7bbd-0e90-407d-aa34-46bf03883377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e341e19ebe4c3784a135755cb617c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:27:13Z,use_quota=True,user_id='5ae69cf3ea8a4d89ab1c7df88eb9fc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Creating volume f9fe7bbd-0e90-407d-aa34-46bf03883377 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:27:12 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:27:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:27:13 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=6, name=volume-f9fe7bbd-0e90-407d-aa34-46bf03883377, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377 1073741824" returned: 0 in 0.306s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377" returned: 0 in 0.103s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] <== create_volume: return (490ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.504s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a700e960-104f-4e8b-834f-13645746d7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fe7bbd-0e90-407d-aa34-46bf03883377', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e938ad1-239f-434f-8177-b318e0dc2376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:13 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Volume volume-f9fe7bbd-0e90-407d-aa34-46bf03883377 (f9fe7bbd-0e90-407d-aa34-46bf03883377): created successfully
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e938ad1-239f-434f-8177-b318e0dc2376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Flow 'volume_create_manager' (70e54e52-4506-4373-9fad-5696b3d2ea7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:27:13 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-601a9884-9c48-4497-bd3c-569496b85776 tempest-TaggedAttachmentsTest-1798107021 None] Created volume successfully.
Sep 17 19:27:23 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:27:23 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:27:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b27367db-30a5-43d9-b665-c9734e36b885 req-8aee4fd6-d712-4eb7-8adf-b85bb3065758 tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:27:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b27367db-30a5-43d9-b665-c9734e36b885 req-8aee4fd6-d712-4eb7-8adf-b85bb3065758 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:27:25 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6577cb7-39d1-4551-967c-9a87d5dfc3c2]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:27:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-b27367db-30a5-43d9-b665-c9734e36b885 req-8aee4fd6-d712-4eb7-8adf-b85bb3065758 tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:27:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-b27367db-30a5-43d9-b665-c9734e36b885 req-8aee4fd6-d712-4eb7-8adf-b85bb3065758 tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13" returned: 0 in 0.557s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:27:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b27367db-30a5-43d9-b665-c9734e36b885 req-8aee4fd6-d712-4eb7-8adf-b85bb3065758 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.632s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:27:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-b27367db-30a5-43d9-b665-c9734e36b885 req-8aee4fd6-d712-4eb7-8adf-b85bb3065758 tempest-AttachVolumeShelveTestJSON-48541388 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75f291e7-d91d-4753-a7fa-40d9cf8d634d', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:27:26 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-b27367db-30a5-43d9-b665-c9734e36b885 req-8aee4fd6-d712-4eb7-8adf-b85bb3065758 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:27:27 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-b27367db-30a5-43d9-b665-c9734e36b885 req-8aee4fd6-d712-4eb7-8adf-b85bb3065758 tempest-AttachVolumeShelveTestJSON-48541388 None] attachment_update completed successfully.
Sep 17 19:27:43 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Flow 'volume_create_manager' (bffad384-f7d5-4e32-a894-078f9c398c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6781f40-3e4a-4d0a-b502-eb1f6c09fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6781f40-3e4a-4d0a-b502-eb1f6c09fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1966352159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69abcc70-5234-4c79-adcd-eac23246b5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587c19190554bf4b8a69263a47476e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:27:43Z,use_quota=True,user_id='3a575878fced44db9a6d3f1491c283dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230203cd-1ff2-4f18-a99a-ce61e77f13c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230203cd-1ff2-4f18-a99a-ce61e77f13c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b1bdbc-fc6b-4bb4-8d73-3c56d3436431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b1bdbc-fc6b-4bb4-8d73-3c56d3436431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69abcc70-5234-4c79-adcd-eac23246b5c0', 'volume_name': 'volume-69abcc70-5234-4c79-adcd-eac23246b5c0', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a4b938-d7c1-47a0-8361-b953ff998c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a4b938-d7c1-47a0-8361-b953ff998c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a54d295-734a-47e7-b0c2-13dc06ff69c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:43 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Volume 69abcc70-5234-4c79-adcd-eac23246b5c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69abcc70-5234-4c79-adcd-eac23246b5c0', 'volume_size': 1}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1966352159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69abcc70-5234-4c79-adcd-eac23246b5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587c19190554bf4b8a69263a47476e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:27:43Z,use_quota=True,user_id='3a575878fced44db9a6d3f1491c283dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Creating volume 69abcc70-5234-4c79-adcd-eac23246b5c0 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:27:43 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:27:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:27:43 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=7, name=volume-69abcc70-5234-4c79-adcd-eac23246b5c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:27:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0 1073741824" returned: 0 in 0.847s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:27:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:27:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0" returned: 0 in 0.187s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:27:44 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] <== create_volume: return (1178ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:27:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:27:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a54d295-734a-47e7-b0c2-13dc06ff69c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69abcc70-5234-4c79-adcd-eac23246b5c0', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6fde7a-1f36-4da8-a50b-96f7fd1063a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:27:46 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Volume volume-69abcc70-5234-4c79-adcd-eac23246b5c0 (69abcc70-5234-4c79-adcd-eac23246b5c0): created successfully
Sep 17 19:27:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6fde7a-1f36-4da8-a50b-96f7fd1063a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:27:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Flow 'volume_create_manager' (bffad384-f7d5-4e32-a894-078f9c398c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:27:46 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-03b73a82-c3a1-4599-9fdb-133b7f4dcbc2 tempest-DeleteServersTestJSON-800246931 None] Created volume successfully.
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.498s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:27:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:27:56 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:27:56 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:28:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-21c0e82a-db7e-4746-91b5-8d351cb8878c req-d5cfa1cd-96cc-422d-8316-c6ef682bb6c8 tempest-DeleteServersTestJSON-800246931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:28:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-21c0e82a-db7e-4746-91b5-8d351cb8878c req-d5cfa1cd-96cc-422d-8316-c6ef682bb6c8 tempest-DeleteServersTestJSON-800246931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:28:03 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cd71c4-0690-40c5-be3e-6ef1275648d6]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:28:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-21c0e82a-db7e-4746-91b5-8d351cb8878c req-d5cfa1cd-96cc-422d-8316-c6ef682bb6c8 tempest-DeleteServersTestJSON-800246931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:28:04 devstack quobyte-client[83143]: System call of process 85858 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:28:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-21c0e82a-db7e-4746-91b5-8d351cb8878c req-d5cfa1cd-96cc-422d-8316-c6ef682bb6c8 tempest-DeleteServersTestJSON-800246931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0" returned: 0 in 1.729s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:28:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-21c0e82a-db7e-4746-91b5-8d351cb8878c req-d5cfa1cd-96cc-422d-8316-c6ef682bb6c8 tempest-DeleteServersTestJSON-800246931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.031s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:28:06 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-21c0e82a-db7e-4746-91b5-8d351cb8878c req-d5cfa1cd-96cc-422d-8316-c6ef682bb6c8 tempest-DeleteServersTestJSON-800246931 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-69abcc70-5234-4c79-adcd-eac23246b5c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4d2c625-ee63-4259-8b64-d78646c21a02', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:28:06 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-21c0e82a-db7e-4746-91b5-8d351cb8878c req-d5cfa1cd-96cc-422d-8316-c6ef682bb6c8 tempest-DeleteServersTestJSON-800246931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:28:06 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-21c0e82a-db7e-4746-91b5-8d351cb8878c req-d5cfa1cd-96cc-422d-8316-c6ef682bb6c8 tempest-DeleteServersTestJSON-800246931 None] attachment_update completed successfully.
Sep 17 19:28:16 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:28:16 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:28:25 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-556b8d15-d519-437b-afb9-ca55c1d0a072 req-ac264008-b048-404b-a2a4-fd28dd58f389 tempest-DeleteServersTestJSON-800246931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:28:25 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-556b8d15-d519-437b-afb9-ca55c1d0a072 req-ac264008-b048-404b-a2a4-fd28dd58f389 tempest-DeleteServersTestJSON-800246931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:28:25 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-556b8d15-d519-437b-afb9-ca55c1d0a072 req-ac264008-b048-404b-a2a4-fd28dd58f389 tempest-DeleteServersTestJSON-800246931 None] Terminate volume connection completed successfully.
Sep 17 19:28:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-556b8d15-d519-437b-afb9-ca55c1d0a072 req-ac264008-b048-404b-a2a4-fd28dd58f389 tempest-DeleteServersTestJSON-800246931 None] Deleting attachment c4d2c625-ee63-4259-8b64-d78646c21a02. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:28:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Acquiring lock "cinder-69abcc70-5234-4c79-adcd-eac23246b5c0-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:28:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Lock "cinder-69abcc70-5234-4c79-adcd-eac23246b5c0-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:28:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:28:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Acquiring lock "cinder-quobyte-69abcc70-5234-4c79-adcd-eac23246b5c0" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:28:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Lock "cinder-quobyte-69abcc70-5234-4c79-adcd-eac23246b5c0" acquired by "delete_volume" :: waited 0.035s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:28:31 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[133464f3-d345-4d07-a868-0ac0e60b1174]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:28:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:28:32 devstack quobyte-client[83143]: System call of process 86766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:28:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0" returned: 0 in 1.164s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:28:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:28:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-69abcc70-5234-4c79-adcd-eac23246b5c0" returned: 0 in 1.444s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:28:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Lock "cinder-quobyte-69abcc70-5234-4c79-adcd-eac23246b5c0" released by "delete_volume" :: held 2.916s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Created reservations ['daf5c739-7420-438d-b458-99c066000f87', '70af7496-6e7b-43ce-b13a-c0f92d1bf8cb', '94ac9005-5f76-4314-bd94-d3109de9149a', '5c3e97d4-89af-4f06-a185-ba5bc3ad7092'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.163s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:28:35 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:28:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Deleted volume successfully.
Sep 17 19:28:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c68ac42d-9da1-48e2-9a06-a1110cb602e8 tempest-DeleteServersTestJSON-800246931 None] Lock "cinder-69abcc70-5234-4c79-adcd-eac23246b5c0-delete_volume" released by "delete_volume" :: held 6.341s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:28:45 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:28:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.164s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:28:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:29:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b3e828ab-f621-449a-94e5-09f167b1957d req-0db18a3a-6628-4496-9104-41916837a744 tempest-TaggedAttachmentsTest-1798107021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:29:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b3e828ab-f621-449a-94e5-09f167b1957d req-0db18a3a-6628-4496-9104-41916837a744 tempest-TaggedAttachmentsTest-1798107021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:29:34 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d059e43-3f8f-4744-a8f2-e67e464dd6f0]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:29:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-b3e828ab-f621-449a-94e5-09f167b1957d req-0db18a3a-6628-4496-9104-41916837a744 tempest-TaggedAttachmentsTest-1798107021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:29:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-b3e828ab-f621-449a-94e5-09f167b1957d req-0db18a3a-6628-4496-9104-41916837a744 tempest-TaggedAttachmentsTest-1798107021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377" returned: 0 in 0.542s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:29:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b3e828ab-f621-449a-94e5-09f167b1957d req-0db18a3a-6628-4496-9104-41916837a744 tempest-TaggedAttachmentsTest-1798107021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.609s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:29:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-b3e828ab-f621-449a-94e5-09f167b1957d req-0db18a3a-6628-4496-9104-41916837a744 tempest-TaggedAttachmentsTest-1798107021 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-f9fe7bbd-0e90-407d-aa34-46bf03883377', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a53b304-b9b9-4ff9-bcf8-a03ce3f2e11c', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:29:34 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-b3e828ab-f621-449a-94e5-09f167b1957d req-0db18a3a-6628-4496-9104-41916837a744 tempest-TaggedAttachmentsTest-1798107021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:29:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-b3e828ab-f621-449a-94e5-09f167b1957d req-0db18a3a-6628-4496-9104-41916837a744 tempest-TaggedAttachmentsTest-1798107021 None] attachment_update completed successfully.
Sep 17 19:29:45 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:29:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.142s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:29:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:30:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-5c042496-e0d1-4026-8724-7574416ce143 req-5e18ebf3-c960-48c2-a371-d08509da4133 tempest-TaggedAttachmentsTest-1798107021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:30:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-5c042496-e0d1-4026-8724-7574416ce143 req-5e18ebf3-c960-48c2-a371-d08509da4133 tempest-TaggedAttachmentsTest-1798107021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:30:12 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-5c042496-e0d1-4026-8724-7574416ce143 req-5e18ebf3-c960-48c2-a371-d08509da4133 tempest-TaggedAttachmentsTest-1798107021 None] Terminate volume connection completed successfully.
Sep 17 19:30:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-5c042496-e0d1-4026-8724-7574416ce143 req-5e18ebf3-c960-48c2-a371-d08509da4133 tempest-TaggedAttachmentsTest-1798107021 None] Deleting attachment 3a53b304-b9b9-4ff9-bcf8-a03ce3f2e11c. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:30:13 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-649eff2d-a784-4ce6-b3b2-e7d35db23b31 req-eb735a1e-d1b6-44a0-be05-dbb1348cf29b tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:30:13 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-649eff2d-a784-4ce6-b3b2-e7d35db23b31 req-eb735a1e-d1b6-44a0-be05-dbb1348cf29b tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:30:13 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-649eff2d-a784-4ce6-b3b2-e7d35db23b31 req-eb735a1e-d1b6-44a0-be05-dbb1348cf29b tempest-AttachVolumeShelveTestJSON-48541388 None] Terminate volume connection completed successfully.
Sep 17 19:30:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-649eff2d-a784-4ce6-b3b2-e7d35db23b31 req-eb735a1e-d1b6-44a0-be05-dbb1348cf29b tempest-AttachVolumeShelveTestJSON-48541388 None] Deleting attachment 75f291e7-d91d-4753-a7fa-40d9cf8d634d. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:30:22 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:30:23 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:30:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Flow 'volume_create_manager' (cd10303d-7085-493d-9a2b-beba3a39986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cf7463-2ae5-4da6-8ae3-61862541fc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cf7463-2ae5-4da6-8ae3-61862541fc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2057152058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fe324e-95ab-4744-af39-5f4a2657a0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0028c6f841457ab5e19b7ee8bef120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:30:47Z,use_quota=True,user_id='3e27d8cb0bfc4925a1e6a50f135327f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863be830-7f5c-4328-a432-d783121726f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863be830-7f5c-4328-a432-d783121726f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5ff984-a54a-4cba-a739-46a18f74a4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5ff984-a54a-4cba-a739-46a18f74a4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6fe324e-95ab-4744-af39-5f4a2657a0d2', 'volume_name': 'volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5bbfb7-0058-48cc-a7ff-2dc3fe8f171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5bbfb7-0058-48cc-a7ff-2dc3fe8f171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee6e53b-5b44-440b-ae1a-519efecb02a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:30:47 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Volume c6fe324e-95ab-4744-af39-5f4a2657a0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2', 'volume_size': 1}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2057152058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fe324e-95ab-4744-af39-5f4a2657a0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0028c6f841457ab5e19b7ee8bef120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:30:47Z,use_quota=True,user_id='3e27d8cb0bfc4925a1e6a50f135327f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Creating volume c6fe324e-95ab-4744-af39-5f4a2657a0d2 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:30:47 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:30:47 devstack quobyte-client[83143]: System call of process 87488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:30:47 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=8, name=volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2 1073741824" returned: 0 in 0.439s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:30:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:30:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2" returned: 0 in 0.092s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:30:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] <== create_volume: return (621ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:30:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.638s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:30:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee6e53b-5b44-440b-ae1a-519efecb02a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:30:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a692b4-05be-43b7-928c-f8c4b9290ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:30:48 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Volume volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2 (c6fe324e-95ab-4744-af39-5f4a2657a0d2): created successfully
Sep 17 19:30:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a692b4-05be-43b7-928c-f8c4b9290ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:30:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Flow 'volume_create_manager' (cd10303d-7085-493d-9a2b-beba3a39986d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:30:49 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1aa13e91-a2dd-4783-8041-3fd21da4f4a3 tempest-AttachVolumeTestJSON-344252043 None] Created volume successfully.
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.382s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:30:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:30:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-694f748e-c59c-4b30-bb3f-d9a08107d2ac req-6e9a412a-3106-4c13-9dc0-111571b7f83c tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:30:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-694f748e-c59c-4b30-bb3f-d9a08107d2ac req-6e9a412a-3106-4c13-9dc0-111571b7f83c tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:30:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f41ed96-97e4-4422-8907-37cc47e2b565]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:30:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-694f748e-c59c-4b30-bb3f-d9a08107d2ac req-6e9a412a-3106-4c13-9dc0-111571b7f83c tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:30:58 devstack quobyte-client[83143]: System call of process 87629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:30:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-694f748e-c59c-4b30-bb3f-d9a08107d2ac req-6e9a412a-3106-4c13-9dc0-111571b7f83c tempest-AttachVolumeTestJSON-344252043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2" returned: 0 in 1.016s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:30:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-694f748e-c59c-4b30-bb3f-d9a08107d2ac req-6e9a412a-3106-4c13-9dc0-111571b7f83c tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.196s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:30:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-694f748e-c59c-4b30-bb3f-d9a08107d2ac req-6e9a412a-3106-4c13-9dc0-111571b7f83c tempest-AttachVolumeTestJSON-344252043 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '057cf088-f398-4852-b1fa-e0849a9982ad', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:30:58 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-694f748e-c59c-4b30-bb3f-d9a08107d2ac req-6e9a412a-3106-4c13-9dc0-111571b7f83c tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:30:59 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-694f748e-c59c-4b30-bb3f-d9a08107d2ac req-6e9a412a-3106-4c13-9dc0-111571b7f83c tempest-AttachVolumeTestJSON-344252043 None] attachment_update completed successfully.
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Acquiring lock "cinder-f9fe7bbd-0e90-407d-aa34-46bf03883377-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Lock "cinder-f9fe7bbd-0e90-407d-aa34-46bf03883377-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:31:03 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Acquiring lock "cinder-quobyte-f9fe7bbd-0e90-407d-aa34-46bf03883377" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Lock "cinder-quobyte-f9fe7bbd-0e90-407d-aa34-46bf03883377" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ed2aa1-966e-4da5-a84e-fbcafc975bd4]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377" returned: 0 in 0.449s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f9fe7bbd-0e90-407d-aa34-46bf03883377" returned: 0 in 0.087s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:31:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Lock "cinder-quobyte-f9fe7bbd-0e90-407d-aa34-46bf03883377" released by "delete_volume" :: held 0.665s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Created reservations ['6af0bc03-bad2-4d13-a83e-92866229f18f', 'd03d8cbe-2ffd-49fc-80c2-7d682744538f', 'd1646956-1158-4273-88c2-a981e4d4b31e', 'f2e51a1a-1e68-4969-bff9-10b342885122'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.188s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:31:04 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:31:04 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Deleted volume successfully.
Sep 17 19:31:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-181092da-b835-4628-a529-b928f25edb4c tempest-TaggedAttachmentsTest-1798107021 None] Lock "cinder-f9fe7bbd-0e90-407d-aa34-46bf03883377-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:31:14 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:31:14 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=7,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:31:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:31:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.145s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:31:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:32:15 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Flow 'volume_create_manager' (86991083-82a4-4fbd-9b6f-0eb2a1c47b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd661531-2874-49df-a5fd-e2c99e52f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd661531-2874-49df-a5fd-e2c99e52f26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1216319631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843d529b-0bd5-43c3-bc60-503d0a9552f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf7efabd7834a22991544f090c9929a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:32:15Z,use_quota=True,user_id='f3e32a4e52244632bd6557df0fa4752d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301326c2-03ec-4d4f-bbcc-3ff5cb71ffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301326c2-03ec-4d4f-bbcc-3ff5cb71ffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29c2100-7f26-42ec-9fc3-35811247e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29c2100-7f26-42ec-9fc3-35811247e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843d529b-0bd5-43c3-bc60-503d0a9552f5', 'volume_name': 'volume-843d529b-0bd5-43c3-bc60-503d0a9552f5', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bafb593-48a7-4d15-b652-2b0341836ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bafb593-48a7-4d15-b652-2b0341836ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc7add0-27c3-4955-a9a0-16b642194a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume 843d529b-0bd5-43c3-bc60-503d0a9552f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843d529b-0bd5-43c3-bc60-503d0a9552f5', 'volume_size': 1}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1216319631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843d529b-0bd5-43c3-bc60-503d0a9552f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf7efabd7834a22991544f090c9929a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:32:15Z,use_quota=True,user_id='f3e32a4e52244632bd6557df0fa4752d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Creating volume 843d529b-0bd5-43c3-bc60-503d0a9552f5 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:32:15 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:32:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-843d529b-0bd5-43c3-bc60-503d0a9552f5 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:15 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=9, name=volume-843d529b-0bd5-43c3-bc60-503d0a9552f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:32:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-843d529b-0bd5-43c3-bc60-503d0a9552f5 1073741824" returned: 0 in 0.880s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-843d529b-0bd5-43c3-bc60-503d0a9552f5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-843d529b-0bd5-43c3-bc60-503d0a9552f5" returned: 0 in 0.193s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] <== create_volume: return (1278ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:32:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc7add0-27c3-4955-a9a0-16b642194a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843d529b-0bd5-43c3-bc60-503d0a9552f5', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8627bf02-f30d-40e7-9037-bd10861efdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume volume-843d529b-0bd5-43c3-bc60-503d0a9552f5 (843d529b-0bd5-43c3-bc60-503d0a9552f5): created successfully
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8627bf02-f30d-40e7-9037-bd10861efdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Flow 'volume_create_manager' (86991083-82a4-4fbd-9b6f-0eb2a1c47b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:32:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Flow 'volume_create_manager' (07a44cf7-3b77-4a30-a2e0-f03f865e89c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f1fe7c-c9c7-4959-9666-31ba1a4035dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:17 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d1ebd0e5-3eb3-42c0-9b86-d76aa3b92ae8 tempest-AttachVolumeShelveTestJSON-48541388 None] Created volume successfully.
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f1fe7c-c9c7-4959-9666-31ba1a4035dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1559487606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abb634d-d99f-4e06-8f9c-1ba924ae1c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9e970085914de99e867068ec1dcc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:32:17Z,use_quota=True,user_id='c7234df898d049ceb595d164ac6b37ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcbead6-389e-4786-b017-447b815b0f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcbead6-389e-4786-b017-447b815b0f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f35a5d6-59c2-45ef-8984-f99e4ada0392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.image.glance [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Creating Keystone auth plugin from conf {{(pid=83122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f35a5d6-59c2-45ef-8984-f99e4ada0392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1abb634d-d99f-4e06-8f9c-1ba924ae1c78', 'volume_name': 'volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842d1a41c0>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4547f79-3118-4605-a5bc-73541c5cf4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4547f79-3118-4605-a5bc-73541c5cf4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba45d157-66ae-4026-9f3b-b16d86b3fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Volume 1abb634d-d99f-4e06-8f9c-1ba924ae1c78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842d1a41c0>}
Sep 17 19:32:17 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Cloning 1abb634d-d99f-4e06-8f9c-1ba924ae1c78 from image 5aeb2b61-d870-4c21-9c73-400584a484f7  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]). {{(pid=83122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 19:32:18 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD, size 20.69 MB, duration 1.07 sec {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 19:32:18 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Image download 20.69 MB at 19.36 MB/s
Sep 17 19:32:19 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb63817-e1da-4eae-9856-a006ebfc7282]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:32:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:20 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD
Sep 17 19:32:20 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:32:22 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Sep 17 19:32:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD" returned: 0 in 3.682s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:22 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Temporary image 5aeb2b61-d870-4c21-9c73-400584a484f7 is fetched for user c7234df898d049ceb595d164ac6b37ae. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 19:32:23 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f558eebc-96d0-4499-9722-859ce9de96b7]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:32:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:24 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD
Sep 17 19:32:24 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:32:27 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD" returned: 0 in 3.951s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1559487606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abb634d-d99f-4e06-8f9c-1ba924ae1c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9e970085914de99e867068ec1dcc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:32:17Z,use_quota=True,user_id='c7234df898d049ceb595d164ac6b37ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Creating volume 1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:32:27 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:32:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:27 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=10, name=volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:32:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 1073741824" returned: 0 in 0.664s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 0 in 0.128s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] <== create_volume: return (1081ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:32:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:29 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Attempting download of 5aeb2b61-d870-4c21-9c73-400584a484f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}])) to volume 1abb634d-d99f-4e06-8f9c-1ba924ae1c78. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 19:32:29 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f167883-53be-4407-91f6-b5dffb6b6eeb]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:32:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_jd8097jw {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_jd8097jw" returned: 0 in 0.487s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_jd8097jw {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_jd8097jw" returned: 1 in 0.607s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_jd8097jw' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:32:30 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[078fcaa3-f0c1-4940-9c9e-fbc6bada5cc5]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:32:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:31 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] 5aeb2b61-d870-4c21-9c73-400584a484f7 was qcow2, converting to raw {{(pid=83122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 19:32:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:31 devstack quobyte-client[83143]: System call of process 88902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:32:31 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=10, name=volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:32:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 0 in 1.616s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:32 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_0ygde9audevstack@QuobyteHD, size 112.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:32:32 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Converted 112.00 MB image at 67.33 MB/s
Sep 17 19:32:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 1G" returned: 0 in 0.266s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:33 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d53d76d-7d08-4553-8b73-ccd37eed1e97]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:32:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 0 in 0.508s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 1 in 0.448s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Downloaded image 5aeb2b61-d870-4c21-9c73-400584a484f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}])) to volume 1abb634d-d99f-4e06-8f9c-1ba924ae1c78 successfully. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Temporary image 5aeb2b61-d870-4c21-9c73-400584a484f7 for user c7234df898d049ceb595d164ac6b37ae is deleted. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Marking volume 1abb634d-d99f-4e06-8f9c-1ba924ae1c78 as bootable. {{(pid=83122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Copying metadata from image 5aeb2b61-d870-4c21-9c73-400584a484f7 to 1abb634d-d99f-4e06-8f9c-1ba924ae1c78. {{(pid=83122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Creating volume glance metadata for volume 1abb634d-d99f-4e06-8f9c-1ba924ae1c78 backed by image 5aeb2b61-d870-4c21-9c73-400584a484f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba45d157-66ae-4026-9f3b-b16d86b3fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842d1a41c0>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea91b964-77e3-43c2-bacf-1bc4cd5b059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:34 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Volume volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 (1abb634d-d99f-4e06-8f9c-1ba924ae1c78): created successfully
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea91b964-77e3-43c2-bacf-1bc4cd5b059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Flow 'volume_create_manager' (07a44cf7-3b77-4a30-a2e0-f03f865e89c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:32:34 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4cf3e278-bdf7-4d49-bcd3-1808487ee677 tempest-TaggedBootDevicesTest-499126592 None] Created volume successfully.
Sep 17 19:32:36 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Flow 'volume_create_manager' (8f083a24-471f-47be-9ccd-fde1f8c8fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cd2b3f-b5e0-4d01-bbbf-93cf886057e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cd2b3f-b5e0-4d01-bbbf-93cf886057e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-936657276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a51691f-0387-4965-8714-a9bc7f08cfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9e970085914de99e867068ec1dcc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:32:36Z,use_quota=True,user_id='c7234df898d049ceb595d164ac6b37ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ef551c-e21d-490f-a928-3d8e03c7814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ef551c-e21d-490f-a928-3d8e03c7814d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf95b85-c7b3-4f5a-80cc-b32c4cf1ff61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf95b85-c7b3-4f5a-80cc-b32c4cf1ff61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a51691f-0387-4965-8714-a9bc7f08cfda', 'volume_name': 'volume-4a51691f-0387-4965-8714-a9bc7f08cfda', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31b0346-b29a-4408-bf68-54e3e0c187b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31b0346-b29a-4408-bf68-54e3e0c187b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5a6c9b-8fb0-4d34-9a54-b6c0daeb13b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:36 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Volume 4a51691f-0387-4965-8714-a9bc7f08cfda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a51691f-0387-4965-8714-a9bc7f08cfda', 'volume_size': 1}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-936657276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a51691f-0387-4965-8714-a9bc7f08cfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9e970085914de99e867068ec1dcc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:32:36Z,use_quota=True,user_id='c7234df898d049ceb595d164ac6b37ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Creating volume 4a51691f-0387-4965-8714-a9bc7f08cfda {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:32:36 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:36 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=11, name=volume-4a51691f-0387-4965-8714-a9bc7f08cfda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda 1073741824" returned: 0 in 0.394s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda" returned: 0 in 0.172s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] <== create_volume: return (642ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:32:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5a6c9b-8fb0-4d34-9a54-b6c0daeb13b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a51691f-0387-4965-8714-a9bc7f08cfda', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabc9071-f103-47e4-9a36-a62bbc9f74a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:37 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Volume volume-4a51691f-0387-4965-8714-a9bc7f08cfda (4a51691f-0387-4965-8714-a9bc7f08cfda): created successfully
Sep 17 19:32:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabc9071-f103-47e4-9a36-a62bbc9f74a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Flow 'volume_create_manager' (8f083a24-471f-47be-9ccd-fde1f8c8fc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:32:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0df59924-ebb0-43bf-8d2a-ccbeeae1cbd8 tempest-TaggedBootDevicesTest-499126592 None] Created volume successfully.
Sep 17 19:32:38 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:32:38 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:32:38 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Flow 'volume_create_manager' (814376f2-0da3-4848-b2bd-3bbf72803b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:32:38 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ed9bf6-0182-4902-85a3-d45a1722ef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ed9bf6-0182-4902-85a3-d45a1722ef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-24432534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f266b8e0-9e8c-4d66-a1bf-8906884a0495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9e970085914de99e867068ec1dcc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:32:39Z,use_quota=True,user_id='c7234df898d049ceb595d164ac6b37ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464ae1dc-52cb-493e-8664-f32601cd444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464ae1dc-52cb-493e-8664-f32601cd444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5aca268-2b26-44cc-aa6b-b669c7aeda2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5aca268-2b26-44cc-aa6b-b669c7aeda2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f266b8e0-9e8c-4d66-a1bf-8906884a0495', 'volume_name': 'volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8fd76f-7498-4e3d-a416-f04779922667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8fd76f-7498-4e3d-a416-f04779922667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e154428-32b6-4520-b27a-fd33cdf470e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:39 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Volume f266b8e0-9e8c-4d66-a1bf-8906884a0495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495', 'volume_size': 1}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-24432534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f266b8e0-9e8c-4d66-a1bf-8906884a0495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9e970085914de99e867068ec1dcc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:32:39Z,use_quota=True,user_id='c7234df898d049ceb595d164ac6b37ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Creating volume f266b8e0-9e8c-4d66-a1bf-8906884a0495 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:32:39 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:39 devstack quobyte-client[83143]: System call of process 88942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:32:39 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=12, name=volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495 1073741824" returned: 0 in 0.493s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495" returned: 0 in 0.330s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] <== create_volume: return (988ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:32:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e154428-32b6-4520-b27a-fd33cdf470e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49985b00-c4c8-49e3-a6a4-d779ffe8d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:32:40 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Volume volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495 (f266b8e0-9e8c-4d66-a1bf-8906884a0495): created successfully
Sep 17 19:32:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49985b00-c4c8-49e3-a6a4-d779ffe8d642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:32:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Flow 'volume_create_manager' (814376f2-0da3-4848-b2bd-3bbf72803b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:32:40 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-340f8646-fe04-4d7b-957c-50ed641b2c62 tempest-TaggedBootDevicesTest-499126592 None] Created volume successfully.
Sep 17 19:32:44 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-65b208cd-d33a-453a-abbd-9e0c5c7d3e34 req-2e919d63-a51b-4a7e-9c86-1facdd92bf04 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:32:44 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-65b208cd-d33a-453a-abbd-9e0c5c7d3e34 req-2e919d63-a51b-4a7e-9c86-1facdd92bf04 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:32:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-65b208cd-d33a-453a-abbd-9e0c5c7d3e34 req-2e919d63-a51b-4a7e-9c86-1facdd92bf04 tempest-AttachVolumeShelveTestJSON-48541388 None] No connector for attachment 23233c8b-7376-439a-9dfc-68f6e33195fe; skipping storage backend terminate_connection call. {{(pid=83122) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 17 19:32:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-65b208cd-d33a-453a-abbd-9e0c5c7d3e34 req-2e919d63-a51b-4a7e-9c86-1facdd92bf04 tempest-AttachVolumeShelveTestJSON-48541388 None] Deleting attachment 23233c8b-7376-439a-9dfc-68f6e33195fe. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.142s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:32:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:32:54 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:32:54 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14,cinder:INSERT=12,cinder:DELETE=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:33:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:33:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:33:09 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e45484f-d73a-4d33-ad4a-cd3c62c96ea1]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:33:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:33:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-8a26d467-f002-4f64-bf3d-cf936cdc396c req-2f360968-a6b0-4ef9-bec3-f4ca6db90311 tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:33:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-8a26d467-f002-4f64-bf3d-cf936cdc396c req-2f360968-a6b0-4ef9-bec3-f4ca6db90311 tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:33:10 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-8a26d467-f002-4f64-bf3d-cf936cdc396c req-2f360968-a6b0-4ef9-bec3-f4ca6db90311 tempest-AttachVolumeTestJSON-344252043 None] Terminate volume connection completed successfully.
Sep 17 19:33:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-8a26d467-f002-4f64-bf3d-cf936cdc396c req-2f360968-a6b0-4ef9-bec3-f4ca6db90311 tempest-AttachVolumeTestJSON-344252043 None] Deleting attachment 057cf088-f398-4852-b1fa-e0849a9982ad. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:33:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 0 in 1.124s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:33:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:33:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 1 in 0.687s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:33:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:33:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.027s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:33:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb35482e-19c2-452d-bd61-f8406da9b9bc', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:33:11 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:33:11 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-317b4f2c-0713-4de4-8ab2-bdfaa64c7137 tempest-TaggedBootDevicesTest-499126592 None] attachment_update completed successfully.
Sep 17 19:33:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-8ad91894-d815-471c-8af2-65b6f109d998 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:33:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-8ad91894-d815-471c-8af2-65b6f109d998 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:33:17 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dae1748-fff6-4899-a719-03d3c8188a55]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:33:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-8ad91894-d815-471c-8af2-65b6f109d998 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:33:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-8ad91894-d815-471c-8af2-65b6f109d998 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda" returned: 0 in 1.331s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:33:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-8ad91894-d815-471c-8af2-65b6f109d998 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.611s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:33:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-8ad91894-d815-471c-8af2-65b6f109d998 tempest-TaggedBootDevicesTest-499126592 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-4a51691f-0387-4965-8714-a9bc7f08cfda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5782f678-a61e-46a7-8f80-0e7a8272ea25', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:33:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-8ad91894-d815-471c-8af2-65b6f109d998 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:33:21 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-8ad91894-d815-471c-8af2-65b6f109d998 tempest-TaggedBootDevicesTest-499126592 None] attachment_update completed successfully.
Sep 17 19:33:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-08f5fc04-5587-482a-9099-aedc7c3f49d5 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:33:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-08f5fc04-5587-482a-9099-aedc7c3f49d5 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:33:25 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c5f548-2b84-497a-9d6f-bfbd4cb93d19]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:33:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-08f5fc04-5587-482a-9099-aedc7c3f49d5 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:33:27 devstack quobyte-client[83143]: System call of process 89283 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:33:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-08f5fc04-5587-482a-9099-aedc7c3f49d5 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495" returned: 0 in 1.317s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:33:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-08f5fc04-5587-482a-9099-aedc7c3f49d5 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.465s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:33:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-08f5fc04-5587-482a-9099-aedc7c3f49d5 tempest-TaggedBootDevicesTest-499126592 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1ba35c5-980f-47bf-a302-f1b671cd339a', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:33:28 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-08f5fc04-5587-482a-9099-aedc7c3f49d5 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:33:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-bb23ff5f-03cb-4a94-a7ed-da0dd3eb2666 req-08f5fc04-5587-482a-9099-aedc7c3f49d5 tempest-TaggedBootDevicesTest-499126592 None] attachment_update completed successfully.
Sep 17 19:33:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:33:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.298s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:33:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.119s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:34:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:34:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "cinder-843d529b-0bd5-43c3-bc60-503d0a9552f5-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:34:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "cinder-843d529b-0bd5-43c3-bc60-503d0a9552f5-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:34:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:34:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "cinder-quobyte-843d529b-0bd5-43c3-bc60-503d0a9552f5" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:34:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "cinder-quobyte-843d529b-0bd5-43c3-bc60-503d0a9552f5" acquired by "delete_volume" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:34:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f4807f-aca9-4f42-9285-bbd83483979d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:34:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-843d529b-0bd5-43c3-bc60-503d0a9552f5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:34:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-843d529b-0bd5-43c3-bc60-503d0a9552f5" returned: 0 in 0.570s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:34:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-843d529b-0bd5-43c3-bc60-503d0a9552f5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:34:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-843d529b-0bd5-43c3-bc60-503d0a9552f5" returned: 0 in 0.174s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "cinder-quobyte-843d529b-0bd5-43c3-bc60-503d0a9552f5" released by "delete_volume" :: held 1.151s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Created reservations ['bde9ad89-a397-4d4f-bb8d-2ed1e8ff9fbf', '54ba4d32-1fc6-4829-aac1-521a72cb3cd4', '82704440-85bb-4a2c-a4f7-7c4ae6d213be', '34b22743-4e31-454e-a47b-910a8fd116e6'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:34:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.133s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:34:59 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:34:59 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Deleted volume successfully.
Sep 17 19:34:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "cinder-9e1e53e5-caec-4d76-be8d-011c34e5fe13-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:34:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dd47a4ae-2ef4-495c-97b5-e388e5be533c tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "cinder-843d529b-0bd5-43c3-bc60-503d0a9552f5-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:34:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "cinder-9e1e53e5-caec-4d76-be8d-011c34e5fe13-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:35:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:35:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "cinder-quobyte-9e1e53e5-caec-4d76-be8d-011c34e5fe13" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:35:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "cinder-quobyte-9e1e53e5-caec-4d76-be8d-011c34e5fe13" acquired by "delete_volume" :: waited 0.029s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:35:00 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[badfd8d0-9d89-4774-bef1-d62db12ce7e9]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:35:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13" returned: 0 in 1.912s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-9e1e53e5-caec-4d76-be8d-011c34e5fe13" returned: 0 in 0.265s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "cinder-quobyte-9e1e53e5-caec-4d76-be8d-011c34e5fe13" released by "delete_volume" :: held 2.493s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:35:02 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Created reservations ['30318db0-c216-4c0c-910d-4501762c2059', '56893979-df29-4846-be76-631bbff3f34e', 'bd869031-4d7d-4df1-a791-8d932264ece9', '92f45d00-d26e-4e50-9eec-7cbccb8d4a35'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.138s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:35:03 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Deleted volume successfully.
Sep 17 19:35:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d26dc49f-7e3b-4236-bcc2-07da50fd1bf7 tempest-AttachVolumeShelveTestJSON-48541388 None] Lock "cinder-9e1e53e5-caec-4d76-be8d-011c34e5fe13-delete_volume" released by "delete_volume" :: held 4.006s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:35:13 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=5 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:35:13 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=15,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:35:15 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Flow 'volume_create_manager' (ccd1e57c-6d03-4587-9559-ab43926b73ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682041bd-11ef-41d5-b261-27f6f5985666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682041bd-11ef-41d5-b261-27f6f5985666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1886168079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c86a44-ce56-4a02-928c-5f3585b6b588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c7dc3ea0c44128a328c52ec7362f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:35:15Z,use_quota=True,user_id='335227b3d3f8401e92b6500f84abaa13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec360b94-97d2-46c1-9383-450fcb8aaca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec360b94-97d2-46c1-9383-450fcb8aaca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59f5eec-fde4-46a6-b2c2-4042bed344fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59f5eec-fde4-46a6-b2c2-4042bed344fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c86a44-ce56-4a02-928c-5f3585b6b588', 'volume_name': 'volume-60c86a44-ce56-4a02-928c-5f3585b6b588', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3884e4c-3fd9-43e1-843f-ae342da94870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3884e4c-3fd9-43e1-843f-ae342da94870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23938013-4b24-43a8-80a0-a3907ff43918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Volume 60c86a44-ce56-4a02-928c-5f3585b6b588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c86a44-ce56-4a02-928c-5f3585b6b588', 'volume_size': 1}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1886168079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c86a44-ce56-4a02-928c-5f3585b6b588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c7dc3ea0c44128a328c52ec7362f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:35:15Z,use_quota=True,user_id='335227b3d3f8401e92b6500f84abaa13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Creating volume 60c86a44-ce56-4a02-928c-5f3585b6b588 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:35:15 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:15 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=13, name=volume-60c86a44-ce56-4a02-928c-5f3585b6b588, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 1073741824" returned: 0 in 0.393s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588" returned: 0 in 0.160s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] <== create_volume: return (627ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:35:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.642s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:35:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23938013-4b24-43a8-80a0-a3907ff43918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c86a44-ce56-4a02-928c-5f3585b6b588', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f78faf-6d3d-4835-80fc-652efb20a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:16 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Volume volume-60c86a44-ce56-4a02-928c-5f3585b6b588 (60c86a44-ce56-4a02-928c-5f3585b6b588): created successfully
Sep 17 19:35:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f78faf-6d3d-4835-80fc-652efb20a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Flow 'volume_create_manager' (ccd1e57c-6d03-4587-9559-ab43926b73ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:35:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-e8a2462e-efb1-4556-bf3e-4b0add39767c req-b34bf938-9bd8-4248-b7be-136d6341ef32 tempest-VolumesSnapshotsTestJSON-2111226215 None] Created volume successfully.
Sep 17 19:35:18 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:35:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:35:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Creating offline snapshot c8884489-455d-407d-9359-9e6bdea4e10e of volume 60c86a44-ce56-4a02-928c-5f3585b6b588 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:35:18 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b93a0c-682c-4cb1-ab91-3bb0332d2c18]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:35:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588" returned: 0 in 0.602s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:19 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=14, name=volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e 1G" returned: 0 in 0.289s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): qemu-img rebase -u -b volume-60c86a44-ce56-4a02-928c-5f3585b6b588 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:19 devstack quobyte-client[83143]: System call of process 90547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "qemu-img rebase -u -b volume-60c86a44-ce56-4a02-928c-5f3585b6b588 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e" returned: 0 in 0.180s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e" returned: 0 in 0.113s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e" returned: 0 in 0.098s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.info" returned: 0 in 0.083s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.info" returned: 0 in 0.118s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:35:20 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-9917841d-0678-4be4-8033-b3b7ae6155b9 req-b07e54c3-da1e-48d9-8b31-33cb66738f77 tempest-VolumesSnapshotsTestJSON-2111226215 None] Create snapshot completed successfully
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "cinder-c8884489-455d-407d-9359-9e6bdea4e10e-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-c8884489-455d-407d-9359-9e6bdea4e10e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:35:21 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "cinder-quobyte-60c86a44-ce56-4a02-928c-5f3585b6b588" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-quobyte-60c86a44-ce56-4a02-928c-5f3585b6b588" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "cinder-quobyte-c8884489-455d-407d-9359-9e6bdea4e10e" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-quobyte-c8884489-455d-407d-9359-9e6bdea4e10e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Deleting offline snapshot c8884489-455d-407d-9359-9e6bdea4e10e of volume 60c86a44-ce56-4a02-928c-5f3585b6b588 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] snapshot_file for this snap is: volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94887788-35b8-4445-ab66-929a3b328d7f]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:35:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e" returned: 0 in 0.451s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60c86a44-ce56-4a02-928c-5f3585b6b588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:35:22 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7963e6ba-973e-4be1-ba1e-06412f6598d2]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:35:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588" returned: 0 in 0.505s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e" returned: 0 in 0.498s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588.c8884489-455d-407d-9359-9e6bdea4e10e" returned: 0 in 0.284s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-quobyte-c8884489-455d-407d-9359-9e6bdea4e10e" released by "_delete_snapshot" :: held 2.592s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:35:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-quobyte-60c86a44-ce56-4a02-928c-5f3585b6b588" released by "delete_snapshot" :: held 2.637s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:35:25 devstack cinder-volume[83122]: WARNING cinder.quota [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:35:25 devstack cinder-volume[83122]: DEBUG cinder.quota [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Created reservations ['3b94cb58-b04b-444b-adf0-fb145583e0d7', 'd76db3cc-4261-476e-8af4-428837023a0c', 'e17ec3ca-4a3a-4183-985e-c1053a8246d6', '193c7e8d-9f76-4635-a062-70546c3a960a'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:35:26 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Delete snapshot completed successfully.
Sep 17 19:35:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-53f12c14-6842-4812-8f29-e8ca341dbfe6 req-0717d0cf-31c5-4cdb-8132-326e86781f69 tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-c8884489-455d-407d-9359-9e6bdea4e10e-delete_snapshot" released by "delete_snapshot" :: held 4.647s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:35:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "cinder-60c86a44-ce56-4a02-928c-5f3585b6b588-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:35:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-60c86a44-ce56-4a02-928c-5f3585b6b588-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:35:27 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:35:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "cinder-quobyte-60c86a44-ce56-4a02-928c-5f3585b6b588" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:35:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-quobyte-60c86a44-ce56-4a02-928c-5f3585b6b588" acquired by "delete_volume" :: waited 0.087s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:35:27 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f257f-9193-46d9-95fa-82803c827b8e]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:35:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:28 devstack quobyte-client[83143]: System call of process 90575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:35:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588" returned: 0 in 1.299s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60c86a44-ce56-4a02-928c-5f3585b6b588" returned: 0 in 0.243s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-quobyte-60c86a44-ce56-4a02-928c-5f3585b6b588" released by "delete_volume" :: held 2.090s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:35:29 devstack cinder-volume[83122]: DEBUG cinder.quota [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Created reservations ['72ca255f-360f-4861-b05c-b2dbb6c1b151', '297a0210-0706-42fa-8af2-cd73f2e7e4af', 'd2de14f7-a9ca-47cc-a604-6b4a7d6a04f3', '2919f1d4-467f-45b7-a097-c37e770ac00f'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:35:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:35:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:35:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:35:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:35:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.313s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:30 devstack cinder-volume[83122]: DEBUG cinder.manager [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:35:30 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Deleted volume successfully.
Sep 17 19:35:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-ed3cbe7c-00c7-40ea-b5ad-b0c3b37b81bb req-1acbed9c-ea5c-4266-aa30-daded83385ab tempest-VolumesSnapshotsTestJSON-2111226215 None] Lock "cinder-60c86a44-ce56-4a02-928c-5f3585b6b588-delete_volume" released by "delete_volume" :: held 4.497s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:35:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb4718d6-897b-41ba-9cce-3b4db1af2189 tempest-BackendsCapabilitiesAdminTestsJSON-1932898733 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83122) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 17 19:35:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9e83b079-9a8d-4446-865c-190b219d73a9 tempest-BackendsCapabilitiesAdminTestsJSON-1932898733 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83122) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 17 19:35:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=9,cinder:UPDATE=17,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:35:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=17,cinder:SELECT=16,cinder:INSERT=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:35:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:35:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:35:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:35:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:35:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.084s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:35:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-64c03999-af6a-4a80-9274-9a9b50d46a96 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:35:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-64c03999-af6a-4a80-9274-9a9b50d46a96 tempest-GroupSnapshotsTest-544819965 None] Group tempest-GroupSnapshotsTest-Group-415854246: creating
Sep 17 19:35:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 1.853s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:35:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-64c03999-af6a-4a80-9274-9a9b50d46a96 tempest-GroupSnapshotsTest-544819965 None] Group tempest-GroupSnapshotsTest-Group-415854246: created successfully
Sep 17 19:35:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-64c03999-af6a-4a80-9274-9a9b50d46a96 tempest-GroupSnapshotsTest-544819965 None] Create group completed successfully.
Sep 17 19:35:56 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Flow 'volume_create_manager' (1e0ff940-e8c0-462f-a16a-5df6d1096bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5a657f-6151-46cb-b3ad-1d5ed4869f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5a657f-6151-46cb-b3ad-1d5ed4869f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-82042047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=89509210-8ce9-4766-8ba9-f189ca87b9de,host='devstack@QuobyteHD#QuobyteHD',id=b6401ccb-dc02-4c96-8809-dd8216444617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85b82b41e1745f386f34704cb3ca159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:35:57Z,use_quota=True,user_id='27ff9a019da44574bf7b5fab3e733816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(833bea84-ab42-437e-9238-7f0aba56a5fe),volume_type_id=833bea84-ab42-437e-9238-7f0aba56a5fe)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca735db8-54b6-41bb-a1e7-ad20da866f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca735db8-54b6-41bb-a1e7-ad20da866f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a3182c-cbff-403f-b071-ab791fb0a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a3182c-cbff-403f-b071-ab791fb0a27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6401ccb-dc02-4c96-8809-dd8216444617', 'volume_name': 'volume-b6401ccb-dc02-4c96-8809-dd8216444617', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207002f4-a225-43ff-b2d4-de0ce819fe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207002f4-a225-43ff-b2d4-de0ce819fe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126e0217-207b-4b07-9d7e-b84738e89da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:56 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Volume b6401ccb-dc02-4c96-8809-dd8216444617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6401ccb-dc02-4c96-8809-dd8216444617', 'volume_size': 1}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=89509210-8ce9-4766-8ba9-f189ca87b9de,created_at=2025-09-17T17:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-82042047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=89509210-8ce9-4766-8ba9-f189ca87b9de,host='devstack@QuobyteHD#QuobyteHD',id=b6401ccb-dc02-4c96-8809-dd8216444617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85b82b41e1745f386f34704cb3ca159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:35:57Z,use_quota=True,user_id='27ff9a019da44574bf7b5fab3e733816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(833bea84-ab42-437e-9238-7f0aba56a5fe),volume_type_id=833bea84-ab42-437e-9238-7f0aba56a5fe)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Creating volume b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:35:57 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:57 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=16, name=volume-b6401ccb-dc02-4c96-8809-dd8216444617, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 1073741824" returned: 0 in 0.787s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:35:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617" returned: 0 in 0.263s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:35:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] <== create_volume: return (1239ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:35:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:35:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126e0217-207b-4b07-9d7e-b84738e89da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6401ccb-dc02-4c96-8809-dd8216444617', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e3fff2-f3bd-46f0-b1bc-fb6ac9407954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:35:58 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Volume volume-b6401ccb-dc02-4c96-8809-dd8216444617 (b6401ccb-dc02-4c96-8809-dd8216444617): created successfully
Sep 17 19:35:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e3fff2-f3bd-46f0-b1bc-fb6ac9407954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:35:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Flow 'volume_create_manager' (1e0ff940-e8c0-462f-a16a-5df6d1096bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:35:58 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-9d66fab3-3b26-46b4-887c-9ff8660943f8 tempest-GroupSnapshotsTest-544819965 None] Created volume successfully.
Sep 17 19:35:59 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] GroupSnapshot 91127223-49bf-4166-89eb-6f617bd2117b: creating.
Sep 17 19:35:59 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:35:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Group snapshot 91127223-49bf-4166-89eb-6f617bd2117b: creating. {{(pid=83122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 19:35:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:35:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Creating offline snapshot b8556e49-f1ed-4751-933e-a9d92ceaf08a of volume b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:36:00 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c0835e-c19d-42bc-ad8c-f30f36b76699]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617" returned: 0 in 0.451s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:00 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=17, name=volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:36:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a 1G" returned: 0 in 0.271s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b6401ccb-dc02-4c96-8809-dd8216444617 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img rebase -u -b volume-b6401ccb-dc02-4c96-8809-dd8216444617 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a" returned: 0 in 0.258s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a" returned: 0 in 0.153s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a" returned: 0 in 0.152s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.info" returned: 0 in 0.107s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.info" returned: 0 in 0.113s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-52848fe4-fb58-482d-8dcf-71f7322085fe tempest-GroupSnapshotsTest-544819965 None] group_snapshot 91127223-49bf-4166-89eb-6f617bd2117b: created successfully
Sep 17 19:36:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-b8556e49-f1ed-4751-933e-a9d92ceaf08a-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" by "_create_volume_from_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-b8556e49-f1ed-4751-933e-a9d92ceaf08a-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Creating volume ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3 from snapshot b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" by "_copy_volume_from_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] snapshot: b8556e49-f1ed-4751-933e-a9d92ceaf08a, volume: ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3,  {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[532eeb31-e742-4edd-81b4-96d69f8abfed]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a" returned: 0 in 0.652s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6401ccb-dc02-4c96-8809-dd8216444617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Creating direct copy from snapshot {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d398e-8f58-4a46-8c61-5c4d9ef5b567]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617" returned: 0 in 0.821s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:06 devstack cinder-volume[83122]: DEBUG cinder.utils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3 not found in is_blk_device check {{(pid=83122) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 19:36:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:06 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=19, name=volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:36:14 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:36:15 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:36:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" returned: 0 in 10.805s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:17 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f3fbc7-4a4b-4328-8324-425e71ddead2]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617" returned: 0 in 0.606s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:18 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617, size 1024.00 MB, duration 10.82 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3 {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:36:18 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Converted 1024.00 MB image at 94.67 MB/s
Sep 17 19:36:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:36:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" returned: 0 in 0.204s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:18 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" released by "_copy_volume_from_snapshot" :: held 13.642s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:36:18 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-b8556e49-f1ed-4751-933e-a9d92ceaf08a-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" released by "_create_volume_from_snapshot" :: held 13.738s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:36:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.824s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0c06a0fe-0073-47a0-842d-78a41988f977 tempest-GroupSnapshotsTest-544819965 None] Create group from source-snapshot-91127223-49bf-4166-89eb-6f617bd2117b completed successfully.
Sep 17 19:36:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" acquired by "delete_volume" :: waited 0.024s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:20 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e21675-c0c3-448b-9452-2d36a67b8aa5]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:21 devstack quobyte-client[83143]: System call of process 90792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:36:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" returned: 0 in 0.464s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" returned: 0 in 0.163s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-ea86fb10-f46a-4ad8-8ba0-d8f90e44e4f3" released by "delete_volume" :: held 0.820s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:36:21 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Created reservations ['75822924-ad72-4b7b-a125-2b7f1f4cdd36'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:36:22 devstack cinder-volume[83122]: WARNING cinder.quota [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2087371074 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2087371074, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:36:22 devstack cinder-volume[83122]: WARNING cinder.quota [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2087371074 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2087371074, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Created reservations ['bb86c238-ce3d-4a69-90bb-7a129d43bf07', 'f8d11089-5337-41e2-b5a3-efc30296b74c', '4dc99ece-edf2-46b6-b6bc-e9a34e402b26', '0141994d-3f4c-4779-9c1a-76a0529ce7fb'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.116s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:22 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:36:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-984ce94e-8aa7-446d-bdc5-705c7816268b tempest-GroupSnapshotsTest-544819965 None] Delete group completed successfully.
Sep 17 19:36:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] group_snapshot 91127223-49bf-4166-89eb-6f617bd2117b: deleting
Sep 17 19:36:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] group_snapshot 91127223-49bf-4166-89eb-6f617bd2117b: deleting {{(pid=83122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-b6401ccb-dc02-4c96-8809-dd8216444617" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-b6401ccb-dc02-4c96-8809-dd8216444617" acquired by "delete_snapshot" :: waited 0.062s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-b8556e49-f1ed-4751-933e-a9d92ceaf08a" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-b8556e49-f1ed-4751-933e-a9d92ceaf08a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Deleting offline snapshot b8556e49-f1ed-4751-933e-a9d92ceaf08a of volume b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] snapshot_file for this snap is: volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb560957-3a2b-42af-b61c-108a30bbd1e0]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:24 devstack quobyte-client[83143]: System call of process 90813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:36:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a" returned: 0 in 0.607s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6401ccb-dc02-4c96-8809-dd8216444617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:36:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[664e5a43-398d-447e-b9ca-1b262855f7a3]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617" returned: 0 in 0.535s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a" returned: 0 in 1.263s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617.b8556e49-f1ed-4751-933e-a9d92ceaf08a" returned: 0 in 0.268s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-b8556e49-f1ed-4751-933e-a9d92ceaf08a" released by "_delete_snapshot" :: held 4.536s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:36:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-b6401ccb-dc02-4c96-8809-dd8216444617" released by "delete_snapshot" :: held 4.649s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:36:30 devstack cinder-volume[83122]: WARNING cinder.quota [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2087371074 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2087371074, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:36:30 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] Created reservations ['e9f37b19-3650-401b-a91a-ce47ec2009ca', 'c6f0c37a-8785-4118-8da9-6b6ddc2c93e6', '3785bc40-18af-48b1-981c-472fa1d8db46', 'f73e673f-2bc5-4a2b-b795-282cde6b95cd'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:36:30 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6ae6a781-0a83-4af9-9542-ed44874871ca tempest-GroupSnapshotsTest-544819965 None] group_snapshot 91127223-49bf-4166-89eb-6f617bd2117b: deleted successfully
Sep 17 19:36:32 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-b6401ccb-dc02-4c96-8809-dd8216444617" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-b6401ccb-dc02-4c96-8809-dd8216444617" acquired by "delete_volume" :: waited 0.179s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:32 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbef0cb-531a-4cbe-9dc3-689fd08927d8]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617" returned: 0 in 1.340s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b6401ccb-dc02-4c96-8809-dd8216444617" returned: 0 in 0.358s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-b6401ccb-dc02-4c96-8809-dd8216444617" released by "delete_volume" :: held 2.167s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:36:35 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Created reservations ['c23cb60d-9c77-464e-acba-2fbd45ea0b61'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:36:35 devstack cinder-volume[83122]: WARNING cinder.db.sqlalchemy.api [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2087371074']
Sep 17 19:36:35 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Created reservations ['cd1c0f7b-de21-4d86-9a54-948e7770b5ef', 'de08c75f-8c0c-42a4-a0c8-645c98859197', '2ded27a0-f102-4f91-8242-49b107a15e72', '2ab8935c-e3ff-4863-a972-31172edee725'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:36:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:36:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:36:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.168s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:36 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:36:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3e87fc7d-fab3-4d00-8659-017f2ce9f95f tempest-GroupSnapshotsTest-544819965 None] Delete group completed successfully.
Sep 17 19:36:37 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b5a6804d-6d54-40ef-8c3c-7d510281fed9 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b5a6804d-6d54-40ef-8c3c-7d510281fed9 tempest-GroupSnapshotsTest-544819965 None] Group tempest-GroupSnapshotsTest-Group-1541212115: creating
Sep 17 19:36:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b5a6804d-6d54-40ef-8c3c-7d510281fed9 tempest-GroupSnapshotsTest-544819965 None] Group tempest-GroupSnapshotsTest-Group-1541212115: created successfully
Sep 17 19:36:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b5a6804d-6d54-40ef-8c3c-7d510281fed9 tempest-GroupSnapshotsTest-544819965 None] Create group completed successfully.
Sep 17 19:36:39 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Flow 'volume_create_manager' (4787e070-a187-4400-b674-8e432bab675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd65b67-54fe-4a4b-aaea-9ce46efeb0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd65b67-54fe-4a4b-aaea-9ce46efeb0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-369906513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7dae665-c584-4cbc-b84f-f7a0a7d2c869,host='devstack@QuobyteHD#QuobyteHD',id=509b6cb9-cc31-4513-ac34-9675e0554db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85b82b41e1745f386f34704cb3ca159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:36:39Z,use_quota=True,user_id='27ff9a019da44574bf7b5fab3e733816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70111ae8-24f5-4fb4-84ad-62bae91a3f36),volume_type_id=70111ae8-24f5-4fb4-84ad-62bae91a3f36)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b506ce29-90f3-4d35-a62f-192980350edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b506ce29-90f3-4d35-a62f-192980350edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234ccb30-0fd7-4c9b-b000-5d93403a91a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234ccb30-0fd7-4c9b-b000-5d93403a91a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509b6cb9-cc31-4513-ac34-9675e0554db8', 'volume_name': 'volume-509b6cb9-cc31-4513-ac34-9675e0554db8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5d1be1-f150-43c6-8726-83f1b560f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5d1be1-f150-43c6-8726-83f1b560f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8e83fd-b968-47ae-9518-6812c9d00aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:39 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Volume 509b6cb9-cc31-4513-ac34-9675e0554db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509b6cb9-cc31-4513-ac34-9675e0554db8', 'volume_size': 1}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a7dae665-c584-4cbc-b84f-f7a0a7d2c869,created_at=2025-09-17T17:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-369906513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7dae665-c584-4cbc-b84f-f7a0a7d2c869,host='devstack@QuobyteHD#QuobyteHD',id=509b6cb9-cc31-4513-ac34-9675e0554db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85b82b41e1745f386f34704cb3ca159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:36:39Z,use_quota=True,user_id='27ff9a019da44574bf7b5fab3e733816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70111ae8-24f5-4fb4-84ad-62bae91a3f36),volume_type_id=70111ae8-24f5-4fb4-84ad-62bae91a3f36)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Creating volume 509b6cb9-cc31-4513-ac34-9675e0554db8 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:36:39 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:39 devstack quobyte-client[83143]: System call of process 91161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:36:39 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=20, name=volume-509b6cb9-cc31-4513-ac34-9675e0554db8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 1073741824" returned: 0 in 0.475s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8" returned: 0 in 0.257s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] <== create_volume: return (852ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:36:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8e83fd-b968-47ae-9518-6812c9d00aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509b6cb9-cc31-4513-ac34-9675e0554db8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bf4034-a53e-423d-be88-d2b787d24ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:40 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Volume volume-509b6cb9-cc31-4513-ac34-9675e0554db8 (509b6cb9-cc31-4513-ac34-9675e0554db8): created successfully
Sep 17 19:36:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bf4034-a53e-423d-be88-d2b787d24ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Flow 'volume_create_manager' (4787e070-a187-4400-b674-8e432bab675a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:36:40 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7b8c0df6-eb71-40af-bf02-634041669e8f tempest-GroupSnapshotsTest-544819965 None] Created volume successfully.
Sep 17 19:36:42 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Flow 'volume_create_manager' (78663a1c-6f89-4861-ae04-a9e35de82642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c277158-c5c9-4473-8c4e-3322ec4121d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c277158-c5c9-4473-8c4e-3322ec4121d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863066198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7dae665-c584-4cbc-b84f-f7a0a7d2c869,host='devstack@QuobyteHD#QuobyteHD',id=f8bdadf5-2c0c-4c84-85dc-b8542b7510de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85b82b41e1745f386f34704cb3ca159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:36:42Z,use_quota=True,user_id='27ff9a019da44574bf7b5fab3e733816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70111ae8-24f5-4fb4-84ad-62bae91a3f36),volume_type_id=70111ae8-24f5-4fb4-84ad-62bae91a3f36)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed507753-7b90-4c79-b686-b3adbaf069f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed507753-7b90-4c79-b686-b3adbaf069f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfb1c3f-d47f-4d74-9716-1a2cf5469e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfb1c3f-d47f-4d74-9716-1a2cf5469e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bdadf5-2c0c-4c84-85dc-b8542b7510de', 'volume_name': 'volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d63fc0-4dd9-4724-a9b5-252cf533e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d63fc0-4dd9-4724-a9b5-252cf533e06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c51bf23-8cff-4cd1-b914-b26ea93a07bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:42 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Volume f8bdadf5-2c0c-4c84-85dc-b8542b7510de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de', 'volume_size': 1}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a7dae665-c584-4cbc-b84f-f7a0a7d2c869,created_at=2025-09-17T17:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863066198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a7dae665-c584-4cbc-b84f-f7a0a7d2c869,host='devstack@QuobyteHD#QuobyteHD',id=f8bdadf5-2c0c-4c84-85dc-b8542b7510de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85b82b41e1745f386f34704cb3ca159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:36:42Z,use_quota=True,user_id='27ff9a019da44574bf7b5fab3e733816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70111ae8-24f5-4fb4-84ad-62bae91a3f36),volume_type_id=70111ae8-24f5-4fb4-84ad-62bae91a3f36)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Creating volume f8bdadf5-2c0c-4c84-85dc-b8542b7510de {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:36:42 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:36:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:42 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=21, name=volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de 1073741824" returned: 0 in 0.459s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" returned: 0 in 0.192s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] <== create_volume: return (750ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c51bf23-8cff-4cd1-b914-b26ea93a07bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19d9362-5f74-494c-8e47-4c453d5563f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:36:43 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Volume volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de (f8bdadf5-2c0c-4c84-85dc-b8542b7510de): created successfully
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19d9362-5f74-494c-8e47-4c453d5563f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:36:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Flow 'volume_create_manager' (78663a1c-6f89-4861-ae04-a9e35de82642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:36:43 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2dc5a5f3-c28e-419e-a44a-d8543f2fbace tempest-GroupSnapshotsTest-544819965 None] Created volume successfully.
Sep 17 19:36:45 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-32a0e8ec-cef4-4dab-9083-4f90f153c542 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:45 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-32a0e8ec-cef4-4dab-9083-4f90f153c542 tempest-GroupSnapshotsTest-544819965 None] Update group completed successfully.
Sep 17 19:36:45 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-8e6eac6c-a95a-4d9b-9167-2c86ff02d2d2 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:45 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-8e6eac6c-a95a-4d9b-9167-2c86ff02d2d2 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:45 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-8e6eac6c-a95a-4d9b-9167-2c86ff02d2d2 tempest-TaggedBootDevicesTest-499126592 None] Terminate volume connection completed successfully.
Sep 17 19:36:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-8e6eac6c-a95a-4d9b-9167-2c86ff02d2d2 tempest-TaggedBootDevicesTest-499126592 None] Deleting attachment eb35482e-19c2-452d-bd61-f8406da9b9bc. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:36:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f9fa3d27-9dd4-4bb4-825a-0cf543953560 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:46 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f9fa3d27-9dd4-4bb4-825a-0cf543953560 tempest-GroupSnapshotsTest-544819965 None] Update group completed successfully.
Sep 17 19:36:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-0f3e7def-3f24-4310-97c0-ba868c41cb7b tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-0f3e7def-3f24-4310-97c0-ba868c41cb7b tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:47 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-0f3e7def-3f24-4310-97c0-ba868c41cb7b tempest-TaggedBootDevicesTest-499126592 None] Terminate volume connection completed successfully.
Sep 17 19:36:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-0f3e7def-3f24-4310-97c0-ba868c41cb7b tempest-TaggedBootDevicesTest-499126592 None] Deleting attachment 5782f678-a61e-46a7-8f80-0e7a8272ea25. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:36:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-5e347567-a0ef-468e-800f-bb25570bcbca tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:47 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-5e347567-a0ef-468e-800f-bb25570bcbca tempest-GroupSnapshotsTest-544819965 None] Update group completed successfully.
Sep 17 19:36:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-93d984a0-b88d-49e8-bd00-31e4eeadf992 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-93d984a0-b88d-49e8-bd00-31e4eeadf992 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:47 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-93d984a0-b88d-49e8-bd00-31e4eeadf992 tempest-TaggedBootDevicesTest-499126592 None] Terminate volume connection completed successfully.
Sep 17 19:36:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c8515f1a-5968-4b1e-a3ed-654709a0d7f2 req-93d984a0-b88d-49e8-bd00-31e4eeadf992 tempest-TaggedBootDevicesTest-499126592 None] Deleting attachment b1ba35c5-980f-47bf-a302-f1b671cd339a. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:36:48 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2d6498c4-e39e-4f37-a663-3f6d8815117c tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:48 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2d6498c4-e39e-4f37-a663-3f6d8815117c tempest-GroupSnapshotsTest-544819965 None] Update group completed successfully.
Sep 17 19:36:50 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] GroupSnapshot 4e72bf6c-b84d-4bec-bf6d-d4cd8f167704: creating.
Sep 17 19:36:50 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Group snapshot 4e72bf6c-b84d-4bec-bf6d-d4cd8f167704: creating. {{(pid=83122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 19:36:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Creating offline snapshot 6e7660b0-9791-4155-a467-a555d1522446 of volume f8bdadf5-2c0c-4c84-85dc-b8542b7510de {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:36:50 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[12315f7c-bc99-4976-96cf-8bdcfa4129c0]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" returned: 0 in 0.485s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:51 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=22, name=volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 1G" returned: 0 in 0.319s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img rebase -u -b volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446" returned: 0 in 0.224s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446" returned: 0 in 0.150s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:36:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446" returned: 0 in 0.147s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.info" returned: 0 in 0.134s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.info" returned: 0 in 0.118s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.019s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Creating offline snapshot c462cfc2-bd29-47f4-b60b-16e1130f2299 of volume 509b6cb9-cc31-4513-ac34-9675e0554db8 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ff75a-9cb3-4c91-b777-29fd4af0092c]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:53 devstack quobyte-client[83143]: System call of process 91213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:36:53 devstack quobyte-client[83143]: System call of process 91213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8" returned: 0 in 0.706s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.401s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:36:53 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=24, name=volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:36:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 1G" returned: 0 in 0.405s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img rebase -u -b volume-509b6cb9-cc31-4513-ac34-9675e0554db8 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img rebase -u -b volume-509b6cb9-cc31-4513-ac34-9675e0554db8 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299" returned: 0 in 0.186s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:36:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299" returned: 0 in 0.181s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:36:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299" returned: 0 in 0.356s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.info" returned: 0 in 0.311s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:36:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.info" returned: 0 in 0.242s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.450s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:36:56 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b47b8c3b-5424-4994-a3cf-8db7d27db02e tempest-GroupSnapshotsTest-544819965 None] group_snapshot 4e72bf6c-b84d-4bec-bf6d-d4cd8f167704: created successfully
Sep 17 19:36:57 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] group_snapshot 4e72bf6c-b84d-4bec-bf6d-d4cd8f167704: deleting
Sep 17 19:36:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] group_snapshot 4e72bf6c-b84d-4bec-bf6d-d4cd8f167704: deleting {{(pid=83122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" acquired by "delete_snapshot" :: waited 0.071s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-6e7660b0-9791-4155-a467-a555d1522446" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-6e7660b0-9791-4155-a467-a555d1522446" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Deleting offline snapshot 6e7660b0-9791-4155-a467-a555d1522446 of volume f8bdadf5-2c0c-4c84-85dc-b8542b7510de {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] snapshot_file for this snap is: volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1448435c-2a6f-4a6f-9b98-0c84078f0f06]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:58 devstack quobyte-client[83143]: System call of process 91261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:36:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "cinder-f266b8e0-9e8c-4d66-a1bf-8906884a0495-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446" returned: 0 in 0.893s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:36:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:36:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-f266b8e0-9e8c-4d66-a1bf-8906884a0495-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:58 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfdcf9c-e875-4af9-bbc9-7147ddf5e2c0]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:36:59 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:36:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "cinder-quobyte-f266b8e0-9e8c-4d66-a1bf-8906884a0495" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:36:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-quobyte-f266b8e0-9e8c-4d66-a1bf-8906884a0495" acquired by "delete_volume" :: waited 0.097s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:36:59 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[860e99ed-6595-43e7-9ca9-040542134358]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:36:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" returned: 0 in 1.459s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:00 devstack quobyte-client[83143]: System call of process 91272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Flow 'volume_create_manager' (7bf13be8-a971-4f8f-b835-1587cb9dd1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5caa4dbb-72ad-4207-9abe-e496c545d3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5caa4dbb-72ad-4207-9abe-e496c545d3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1344398458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff87eeb8-c053-4fca-b5e2-522098e40846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0028c6f841457ab5e19b7ee8bef120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:37:00Z,use_quota=True,user_id='3e27d8cb0bfc4925a1e6a50f135327f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18b360d-c61f-4cd9-b760-22f4eeb7bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18b360d-c61f-4cd9-b760-22f4eeb7bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebdaf34-3b67-459c-be3b-a78589be254d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebdaf34-3b67-459c-be3b-a78589be254d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff87eeb8-c053-4fca-b5e2-522098e40846', 'volume_name': 'volume-ff87eeb8-c053-4fca-b5e2-522098e40846', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd334100-425d-41d4-8580-8aa9d39e0cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd334100-425d-41d4-8580-8aa9d39e0cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955bb403-d3a9-4e2d-9b7a-9987df69d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:00 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Volume ff87eeb8-c053-4fca-b5e2-522098e40846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff87eeb8-c053-4fca-b5e2-522098e40846', 'volume_size': 1}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1344398458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff87eeb8-c053-4fca-b5e2-522098e40846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0028c6f841457ab5e19b7ee8bef120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:37:00Z,use_quota=True,user_id='3e27d8cb0bfc4925a1e6a50f135327f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Creating volume ff87eeb8-c053-4fca-b5e2-522098e40846 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:37:00 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:37:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495" returned: 0 in 1.447s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:01 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=26, name=volume-ff87eeb8-c053-4fca-b5e2-522098e40846, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446" returned: 0 in 0.796s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f266b8e0-9e8c-4d66-a1bf-8906884a0495" returned: 0 in 0.265s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-quobyte-f266b8e0-9e8c-4d66-a1bf-8906884a0495" released by "delete_volume" :: held 1.935s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846 1073741824" returned: 0 in 0.648s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de.6e7660b0-9791-4155-a467-a555d1522446" returned: 0 in 0.456s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-6e7660b0-9791-4155-a467-a555d1522446" released by "_delete_snapshot" :: held 4.363s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846" returned: 0 in 0.490s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] <== create_volume: return (1223ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" released by "delete_snapshot" :: held 4.562s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Created reservations ['bd7a6ff2-9d09-41d2-9d72-42a3e7ceaa5e', 'fa81cfc5-cfcd-43d1-974b-faa1f5d8d092', 'f817898f-9473-4848-993f-339c2fd97892', '9c56aaff-c1e3-428f-a067-6d192c809daa'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955bb403-d3a9-4e2d-9b7a-9987df69d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff87eeb8-c053-4fca-b5e2-522098e40846', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d09e714-c7e3-46eb-a842-72afde7696d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:02 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Volume volume-ff87eeb8-c053-4fca-b5e2-522098e40846 (ff87eeb8-c053-4fca-b5e2-522098e40846): created successfully
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d09e714-c7e3-46eb-a842-72afde7696d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Flow 'volume_create_manager' (7bf13be8-a971-4f8f-b835-1587cb9dd1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-509b6cb9-cc31-4513-ac34-9675e0554db8" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3887da6f-5da6-4287-91fd-d203035cc49e tempest-AttachVolumeTestJSON-344252043 None] Created volume successfully.
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-509b6cb9-cc31-4513-ac34-9675e0554db8" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-c462cfc2-bd29-47f4-b60b-16e1130f2299" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-c462cfc2-bd29-47f4-b60b-16e1130f2299" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Deleting offline snapshot c462cfc2-bd29-47f4-b60b-16e1130f2299 of volume 509b6cb9-cc31-4513-ac34-9675e0554db8 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] snapshot_file for this snap is: volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e04a2-22ac-4c7f-b65a-782c98dbf337]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.159s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:37:03 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Deleted volume successfully.
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "cinder-4a51691f-0387-4965-8714-a9bc7f08cfda-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299" returned: 0 in 1.176s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-509b6cb9-cc31-4513-ac34-9675e0554db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c45d08e2-e26c-4291-8859-467b28081065 tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-f266b8e0-9e8c-4d66-a1bf-8906884a0495-delete_volume" released by "delete_volume" :: held 5.048s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1334756a-f772-4bc8-b9ca-5bfb766f4efb]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-4a51691f-0387-4965-8714-a9bc7f08cfda-delete_volume" acquired by "delete_volume" :: waited 0.251s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "cinder-quobyte-4a51691f-0387-4965-8714-a9bc7f08cfda" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-quobyte-4a51691f-0387-4965-8714-a9bc7f08cfda" acquired by "delete_volume" :: waited 0.043s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:04 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[072bb857-b7e1-4fa7-a072-7ba48aa693bb]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:04 devstack quobyte-client[83143]: System call of process 91309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8" returned: 0 in 0.796s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:04 devstack quobyte-client[83143]: System call of process 91313 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299" returned: 0 in 0.292s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda" returned: 0 in 0.759s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8.c462cfc2-bd29-47f4-b60b-16e1130f2299" returned: 0 in 0.242s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4a51691f-0387-4965-8714-a9bc7f08cfda" returned: 0 in 0.239s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-c462cfc2-bd29-47f4-b60b-16e1130f2299" released by "_delete_snapshot" :: held 3.029s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-quobyte-4a51691f-0387-4965-8714-a9bc7f08cfda" released by "delete_volume" :: held 1.151s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-509b6cb9-cc31-4513-ac34-9675e0554db8" released by "delete_snapshot" :: held 3.285s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:05 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Created reservations ['79fcd496-4c81-43c7-be54-bc44f2d2c7e2', 'b6bf2ccd-a9f4-428a-add4-7e6f2c0cd476', 'c4016c33-bd19-4375-ab08-f2c87f5f597f', '783bca08-019b-475d-9ab5-95aa11bc7761'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:06 devstack cinder-volume[83122]: WARNING cinder.quota [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-342282080 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-342282080, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:06 devstack cinder-volume[83122]: WARNING cinder.quota [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-342282080 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-342282080, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Created reservations ['ef472095-945f-4599-8145-dc16c2a4efb3', 'd2ac582f-d213-4715-a42c-27aa42590956', 'c94b54e7-78c3-4e6d-988d-bab15312cab5', '029e9eb7-4e5c-4676-9eeb-475162726882'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.263s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:37:06 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Deleted volume successfully.
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ed723bd3-1fdf-4225-9218-b3eecf0bac6b tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-4a51691f-0387-4965-8714-a9bc7f08cfda-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:06 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] Created reservations ['139247dc-2ebd-4531-a183-207e3aa4bcdb', '824ffaf6-c69d-4e7d-8fb4-3ac4f95a9eb0', 'f7369575-1abf-4d88-ab29-4d08f0c95b6d', 'ab29e0f7-727f-4649-bd1f-2c8f9b855ad9'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:07 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a8ac6498-74da-4ecc-9e07-11a9ea2fd7e1 tempest-GroupSnapshotsTest-544819965 None] group_snapshot 4e72bf6c-b84d-4bec-bf6d-d4cd8f167704: deleted successfully
Sep 17 19:37:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "cinder-1abb634d-d99f-4e06-8f9c-1ba924ae1c78-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-1abb634d-d99f-4e06-8f9c-1ba924ae1c78-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:07 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "cinder-quobyte-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-quobyte-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" acquired by "delete_volume" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:07 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a916c5a3-e7f0-4fff-9f84-7784fea9e544]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 0 in 1.269s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-509b6cb9-cc31-4513-ac34-9675e0554db8" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b89ff739-af61-4f2b-b589-78c27dbe4105 req-e737ffea-6f72-4b8e-ac31-d0dd10aee5e2 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b89ff739-af61-4f2b-b589-78c27dbe4105 req-e737ffea-6f72-4b8e-ac31-d0dd10aee5e2 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36c4f62-3b45-4fcb-a44a-7ea42e123583]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-b89ff739-af61-4f2b-b589-78c27dbe4105 req-e737ffea-6f72-4b8e-ac31-d0dd10aee5e2 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:09 devstack quobyte-client[83143]: System call of process 91331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-509b6cb9-cc31-4513-ac34-9675e0554db8" acquired by "delete_volume" :: waited 0.296s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d079ee-bdfe-4823-8384-991b63ee0416]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 1 in 0.970s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:37:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" returned: 0 in 0.135s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-quobyte-1abb634d-d99f-4e06-8f9c-1ba924ae1c78" released by "delete_volume" :: held 2.795s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-b89ff739-af61-4f2b-b589-78c27dbe4105 req-e737ffea-6f72-4b8e-ac31-d0dd10aee5e2 tempest-AttachVolumeTestJSON-344252043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846" returned: 0 in 1.016s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b89ff739-af61-4f2b-b589-78c27dbe4105 req-e737ffea-6f72-4b8e-ac31-d0dd10aee5e2 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.079s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8" returned: 0 in 0.754s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Created reservations ['31426a83-5510-4e3a-b43a-f139716d78f2', 'e66e8bc4-66ff-42af-ad75-22a082bd31eb', '8c9a0842-de9c-4766-810d-d4049734b29f', 'ad441148-1186-45c4-a3e4-283b9223a16c'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-509b6cb9-cc31-4513-ac34-9675e0554db8" returned: 0 in 0.425s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-b89ff739-af61-4f2b-b589-78c27dbe4105 req-e737ffea-6f72-4b8e-ac31-d0dd10aee5e2 tempest-AttachVolumeTestJSON-344252043 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-ff87eeb8-c053-4fca-b5e2-522098e40846', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43358a3a-4cdd-4255-8c64-51c47fc8e500', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:37:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-b89ff739-af61-4f2b-b589-78c27dbe4105 req-e737ffea-6f72-4b8e-ac31-d0dd10aee5e2 tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-509b6cb9-cc31-4513-ac34-9675e0554db8" released by "delete_volume" :: held 1.477s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" acquired by "delete_volume" :: waited 0.062s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a63cb-c24c-4cdc-9844-12fc555151ab]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:11 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-b89ff739-af61-4f2b-b589-78c27dbe4105 req-e737ffea-6f72-4b8e-ac31-d0dd10aee5e2 tempest-AttachVolumeTestJSON-344252043 None] attachment_update completed successfully.
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.462s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:37:11 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Deleted volume successfully.
Sep 17 19:37:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2a2196f7-fd51-4202-8ef9-b5e218192f88 tempest-TaggedBootDevicesTest-499126592 None] Lock "cinder-1abb634d-d99f-4e06-8f9c-1ba924ae1c78-delete_volume" released by "delete_volume" :: held 4.579s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" returned: 0 in 0.691s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" returned: 0 in 0.137s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-f8bdadf5-2c0c-4c84-85dc-b8542b7510de" released by "delete_volume" :: held 1.356s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Created reservations ['d2ea1c9a-8378-4ed4-a563-b019520c3a0d'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:13 devstack cinder-volume[83122]: WARNING cinder.quota [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-342282080 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-342282080, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Created reservations ['5b5f2d8b-a960-43e9-8495-cbec825f80b8', '797944a9-47e7-465e-a568-9382b4a5e28c', '50d465f1-b2eb-4291-a0ac-8033f1f727ee', '9d94b7af-b43a-42c6-b50d-0c6d89cf460b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Created reservations ['77e9af44-8cb6-4cad-98e1-0af2f8687222', '4e192a6f-8c77-40d7-9e9a-2ed1fcd60fc6', 'd286141a-80f0-4442-987d-1607e34e335c', 'b91df3ac-b185-45fa-abff-220a97427f93'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.134s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:13 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:37:14 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2d35ea22-48b6-4ad8-aeec-55cae4f73893 tempest-GroupSnapshotsTest-544819965 None] Delete group completed successfully.
Sep 17 19:37:15 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=101,cinder:SELECT=98,cinder:INSERT=20,cinder:DELETE=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:37:15 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-8059a3f2-c2d2-4ff9-8d7c-300355f01175 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8059a3f2-c2d2-4ff9-8d7c-300355f01175 tempest-GroupSnapshotsTest-544819965 None] Group tempest-GroupSnapshotsTest-Group-63447886: creating
Sep 17 19:37:15 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=96,cinder:SELECT=95,cinder:INSERT=23,cinder:DELETE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:37:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8059a3f2-c2d2-4ff9-8d7c-300355f01175 tempest-GroupSnapshotsTest-544819965 None] Group tempest-GroupSnapshotsTest-Group-63447886: created successfully
Sep 17 19:37:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8059a3f2-c2d2-4ff9-8d7c-300355f01175 tempest-GroupSnapshotsTest-544819965 None] Create group completed successfully.
Sep 17 19:37:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Flow 'volume_create_manager' (f35dacf9-956d-47a6-a9ae-7dca320cc077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a13bec8-ccf3-433e-ae4d-12651ef6ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a13bec8-ccf3-433e-ae4d-12651ef6ec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-514671988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=09ec0336-2990-4ee2-b8ac-40692bbb6992,host='devstack@QuobyteHD#QuobyteHD',id=487b4dae-9165-4b82-9fd5-b909e38dfa48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85b82b41e1745f386f34704cb3ca159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:37:17Z,use_quota=True,user_id='27ff9a019da44574bf7b5fab3e733816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97111967-75ad-4541-998f-b27c86426baf),volume_type_id=97111967-75ad-4541-998f-b27c86426baf)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9725ebb-c2c6-484c-87ab-98da19d1978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9725ebb-c2c6-484c-87ab-98da19d1978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b8e884-3f3c-4f94-ac2c-aa5f893a4d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b8e884-3f3c-4f94-ac2c-aa5f893a4d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487b4dae-9165-4b82-9fd5-b909e38dfa48', 'volume_name': 'volume-487b4dae-9165-4b82-9fd5-b909e38dfa48', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0aa1e50-a5c9-46d2-a0f1-1563245c588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0aa1e50-a5c9-46d2-a0f1-1563245c588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9530f501-0c61-4007-baba-2ea0ac5978ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Volume 487b4dae-9165-4b82-9fd5-b909e38dfa48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487b4dae-9165-4b82-9fd5-b909e38dfa48', 'volume_size': 1}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=09ec0336-2990-4ee2-b8ac-40692bbb6992,created_at=2025-09-17T17:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-514671988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=09ec0336-2990-4ee2-b8ac-40692bbb6992,host='devstack@QuobyteHD#QuobyteHD',id=487b4dae-9165-4b82-9fd5-b909e38dfa48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85b82b41e1745f386f34704cb3ca159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:37:17Z,use_quota=True,user_id='27ff9a019da44574bf7b5fab3e733816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97111967-75ad-4541-998f-b27c86426baf),volume_type_id=97111967-75ad-4541-998f-b27c86426baf)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Creating volume 487b4dae-9165-4b82-9fd5-b909e38dfa48 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:37:17 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:17 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=27, name=volume-487b4dae-9165-4b82-9fd5-b909e38dfa48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 1073741824" returned: 0 in 0.366s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48" returned: 0 in 0.101s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] <== create_volume: return (668ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:37:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9530f501-0c61-4007-baba-2ea0ac5978ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487b4dae-9165-4b82-9fd5-b909e38dfa48', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782b59d6-dfe8-49d1-9add-acddda4f41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Volume volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 (487b4dae-9165-4b82-9fd5-b909e38dfa48): created successfully
Sep 17 19:37:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782b59d6-dfe8-49d1-9add-acddda4f41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Flow 'volume_create_manager' (f35dacf9-956d-47a6-a9ae-7dca320cc077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:37:18 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-717bdd41-0e89-4de3-a4ed-ace363b6c052 tempest-GroupSnapshotsTest-544819965 None] Created volume successfully.
Sep 17 19:37:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] GroupSnapshot 570a56f5-54cc-4b01-96c9-52f4c172a524: creating.
Sep 17 19:37:19 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Group snapshot 570a56f5-54cc-4b01-96c9-52f4c172a524: creating. {{(pid=83122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Creating offline snapshot 744c2b78-fc73-4597-83db-cfd0783e7238 of volume 487b4dae-9165-4b82-9fd5-b909e38dfa48 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dc7a51-5455-4354-9f4d-a2247faea19d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Flow 'volume_create_manager' (8dbba100-b6a1-4c75-9a2d-9c2cff5f4467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25538a36-d6f7-4bfd-bc68-949654831ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25538a36-d6f7-4bfd-bc68-949654831ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-146103095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898958c6-7734-4c21-813d-09fea882aa5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0028c6f841457ab5e19b7ee8bef120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:37:20Z,use_quota=True,user_id='3e27d8cb0bfc4925a1e6a50f135327f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255d1c8b-7922-449c-8f54-ecb59f3dcba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255d1c8b-7922-449c-8f54-ecb59f3dcba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8c012-5496-4ac6-8308-332111ce462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8c012-5496-4ac6-8308-332111ce462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898958c6-7734-4c21-813d-09fea882aa5e', 'volume_name': 'volume-898958c6-7734-4c21-813d-09fea882aa5e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573bdbfd-b38d-4ebb-8add-818062829c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573bdbfd-b38d-4ebb-8add-818062829c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8a87fa-4c48-4416-9da5-a6b51af3a1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:20 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Volume 898958c6-7734-4c21-813d-09fea882aa5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898958c6-7734-4c21-813d-09fea882aa5e', 'volume_size': 1}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48" returned: 0 in 0.775s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:21 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=28, name=volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 1G" returned: 0 in 0.278s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img rebase -u -b volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:21 devstack quobyte-client[83143]: System call of process 91747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img rebase -u -b volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238" returned: 0 in 0.182s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238" returned: 0 in 0.096s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238" returned: 0 in 0.183s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.info" returned: 0 in 0.147s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:37:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.info" returned: 0 in 0.102s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-146103095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898958c6-7734-4c21-813d-09fea882aa5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0028c6f841457ab5e19b7ee8bef120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:37:20Z,use_quota=True,user_id='3e27d8cb0bfc4925a1e6a50f135327f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Creating volume 898958c6-7734-4c21-813d-09fea882aa5e {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:37:22 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:22 devstack quobyte-client[83143]: System call of process 91755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:22 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=30, name=volume-898958c6-7734-4c21-813d-09fea882aa5e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e 1073741824" returned: 0 in 0.431s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e" returned: 0 in 0.332s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] <== create_volume: return (826ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8a87fa-4c48-4416-9da5-a6b51af3a1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898958c6-7734-4c21-813d-09fea882aa5e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d82d5ae-7345-4d9c-813a-3165adc3b9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:23 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Volume volume-898958c6-7734-4c21-813d-09fea882aa5e (898958c6-7734-4c21-813d-09fea882aa5e): created successfully
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d82d5ae-7345-4d9c-813a-3165adc3b9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Flow 'volume_create_manager' (8dbba100-b6a1-4c75-9a2d-9c2cff5f4467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:37:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-88148a97-f0b9-4ea7-ada6-4043f35fca45 tempest-GroupSnapshotsTest-544819965 None] group_snapshot 570a56f5-54cc-4b01-96c9-52f4c172a524: created successfully
Sep 17 19:37:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4fc1b8a9-2db6-48e8-bea8-d8b88f871315 tempest-AttachVolumeTestJSON-344252043 None] Created volume successfully.
Sep 17 19:37:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] group_snapshot 570a56f5-54cc-4b01-96c9-52f4c172a524: deleting
Sep 17 19:37:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] group_snapshot 570a56f5-54cc-4b01-96c9-52f4c172a524: deleting {{(pid=83122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-487b4dae-9165-4b82-9fd5-b909e38dfa48" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-487b4dae-9165-4b82-9fd5-b909e38dfa48" acquired by "delete_snapshot" :: waited 0.068s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-744c2b78-fc73-4597-83db-cfd0783e7238" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-744c2b78-fc73-4597-83db-cfd0783e7238" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Deleting offline snapshot 744c2b78-fc73-4597-83db-cfd0783e7238 of volume 487b4dae-9165-4b82-9fd5-b909e38dfa48 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] snapshot_file for this snap is: volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb11aa-a83a-47f1-b329-3fa40a9c67cc]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:24 devstack quobyte-client[83143]: System call of process 91760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238" returned: 0 in 0.585s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487b4dae-9165-4b82-9fd5-b909e38dfa48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:37:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd6a0c6-39fc-45b8-8b1d-53ddc7ac9c3d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48" returned: 0 in 0.463s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:25 devstack quobyte-client[83143]: System call of process 91772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238" returned: 0 in 0.267s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48.744c2b78-fc73-4597-83db-cfd0783e7238" returned: 0 in 0.102s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-744c2b78-fc73-4597-83db-cfd0783e7238" released by "_delete_snapshot" :: held 1.798s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-487b4dae-9165-4b82-9fd5-b909e38dfa48" released by "delete_snapshot" :: held 1.824s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:26 devstack cinder-volume[83122]: WARNING cinder.quota [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1052339069 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1052339069, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:26 devstack cinder-volume[83122]: WARNING cinder.quota [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1052339069 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1052339069, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:26 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] Created reservations ['a71517c2-1149-4008-9fc9-199b2f30c150', '91df9f08-f03d-4f38-b551-05f9db72aca6', '5066bc37-ae9f-48cd-8a30-7133f02cd004', 'ca3147cb-bf90-41f0-baf8-13796bcdd570'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:26 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a484f125-2e5c-48fa-a4e4-45875b82a426 tempest-GroupSnapshotsTest-544819965 None] group_snapshot 570a56f5-54cc-4b01-96c9-52f4c172a524: deleted successfully
Sep 17 19:37:27 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "cinder-quobyte-487b4dae-9165-4b82-9fd5-b909e38dfa48" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-487b4dae-9165-4b82-9fd5-b909e38dfa48" acquired by "delete_volume" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:27 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a050003-c9ab-48aa-9c98-e90e799accf3]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48" returned: 0 in 0.621s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-487b4dae-9165-4b82-9fd5-b909e38dfa48" returned: 0 in 0.190s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Lock "cinder-quobyte-487b4dae-9165-4b82-9fd5-b909e38dfa48" released by "delete_volume" :: held 1.062s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b3f43aa9-73ff-449f-8de2-88ba214f6254 req-b6ec9575-00be-4cfd-b4b1-d13ead8dd579 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b3f43aa9-73ff-449f-8de2-88ba214f6254 req-b6ec9575-00be-4cfd-b4b1-d13ead8dd579 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[256bcf6d-7627-4d83-ba3b-5498c1a5aa25]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-b3f43aa9-73ff-449f-8de2-88ba214f6254 req-b6ec9575-00be-4cfd-b4b1-d13ead8dd579 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Created reservations ['dd819638-31ee-4533-819b-924f18f001f3'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:29 devstack cinder-volume[83122]: WARNING cinder.quota [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1052339069 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1052339069, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Created reservations ['9f2ee583-ae3a-484b-9591-dc66d67d98d8', '70a99e14-1113-4ea8-b45d-e9212fe5f053', 'a5afca24-ca35-45f8-9c31-69d1889f6a90', '56ae8657-73ea-4904-91a8-fd5acd1a382b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-b3f43aa9-73ff-449f-8de2-88ba214f6254 req-b6ec9575-00be-4cfd-b4b1-d13ead8dd579 tempest-AttachVolumeTestJSON-344252043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e" returned: 0 in 0.685s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-b3f43aa9-73ff-449f-8de2-88ba214f6254 req-b6ec9575-00be-4cfd-b4b1-d13ead8dd579 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.723s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-b3f43aa9-73ff-449f-8de2-88ba214f6254 req-b6ec9575-00be-4cfd-b4b1-d13ead8dd579 tempest-AttachVolumeTestJSON-344252043 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-898958c6-7734-4c21-813d-09fea882aa5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26860755-ffc6-4600-becf-972c803d1979', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:37:29 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-b3f43aa9-73ff-449f-8de2-88ba214f6254 req-b6ec9575-00be-4cfd-b4b1-d13ead8dd579 tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:30 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-b3f43aa9-73ff-449f-8de2-88ba214f6254 req-b6ec9575-00be-4cfd-b4b1-d13ead8dd579 tempest-AttachVolumeTestJSON-344252043 None] attachment_update completed successfully.
Sep 17 19:37:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.121s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:30 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:37:30 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-564eebb2-dfac-4f3a-bf78-b44a2eb7d2e4 tempest-GroupSnapshotsTest-544819965 None] Delete group completed successfully.
Sep 17 19:37:41 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-916a0263-a29a-4a1c-8f81-516aee16b30a tempest-GroupSnapshotsV319Test-1289141563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:41 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-916a0263-a29a-4a1c-8f81-516aee16b30a tempest-GroupSnapshotsV319Test-1289141563 None] Group tempest-GroupSnapshotsV319Test-Group-766914722: creating
Sep 17 19:37:41 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-916a0263-a29a-4a1c-8f81-516aee16b30a tempest-GroupSnapshotsV319Test-1289141563 None] Group tempest-GroupSnapshotsV319Test-Group-766914722: created successfully
Sep 17 19:37:41 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-916a0263-a29a-4a1c-8f81-516aee16b30a tempest-GroupSnapshotsV319Test-1289141563 None] Create group completed successfully.
Sep 17 19:37:43 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Flow 'volume_create_manager' (24f04f8e-30a0-45da-8ab1-e22b5724771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4209d945-f16d-4679-96d8-ea821104f446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4209d945-f16d-4679-96d8-ea821104f446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1384004523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5f60973-5ea9-4d8e-8d74-ff5d7e10bfb9,host='devstack@QuobyteHD#QuobyteHD',id=0c56025e-a87b-4b0e-bc39-30c2a4aec9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f273068c942e432e8a89b56b0ce60247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:37:43Z,use_quota=True,user_id='a78cf5f760eb41b7a6a2ae5546e5a0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31902fbb-451e-4523-8bb3-7be048a08f28),volume_type_id=31902fbb-451e-4523-8bb3-7be048a08f28)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfe3a3b-f744-4b9d-99f5-c6d662809335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfe3a3b-f744-4b9d-99f5-c6d662809335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a80e79-7a5a-4214-aab6-fc6892ab6c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a80e79-7a5a-4214-aab6-fc6892ab6c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c56025e-a87b-4b0e-bc39-30c2a4aec9ff', 'volume_name': 'volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3baf4fc-1127-457b-85a0-11119a285d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3baf4fc-1127-457b-85a0-11119a285d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80915773-7110-4a32-b68e-d7414cce2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:43 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Volume 0c56025e-a87b-4b0e-bc39-30c2a4aec9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff', 'volume_size': 1}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b5f60973-5ea9-4d8e-8d74-ff5d7e10bfb9,created_at=2025-09-17T17:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1384004523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5f60973-5ea9-4d8e-8d74-ff5d7e10bfb9,host='devstack@QuobyteHD#QuobyteHD',id=0c56025e-a87b-4b0e-bc39-30c2a4aec9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f273068c942e432e8a89b56b0ce60247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:37:43Z,use_quota=True,user_id='a78cf5f760eb41b7a6a2ae5546e5a0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31902fbb-451e-4523-8bb3-7be048a08f28),volume_type_id=31902fbb-451e-4523-8bb3-7be048a08f28)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Creating volume 0c56025e-a87b-4b0e-bc39-30c2a4aec9ff {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:37:43 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:43 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=31, name=volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff 1073741824" returned: 0 in 0.366s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" returned: 0 in 0.139s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] <== create_volume: return (590ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:37:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.603s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80915773-7110-4a32-b68e-d7414cce2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0b5c98-802d-4ce7-922f-62cb46eec575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:37:44 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Volume volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff (0c56025e-a87b-4b0e-bc39-30c2a4aec9ff): created successfully
Sep 17 19:37:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0b5c98-802d-4ce7-922f-62cb46eec575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:37:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Flow 'volume_create_manager' (24f04f8e-30a0-45da-8ab1-e22b5724771c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:37:44 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e054d928-abd1-47b7-87bb-90795f0da767 tempest-GroupSnapshotsV319Test-1289141563 None] Created volume successfully.
Sep 17 19:37:46 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] GroupSnapshot b320542f-d3dd-4079-b186-038d076e1848: creating.
Sep 17 19:37:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Group snapshot b320542f-d3dd-4079-b186-038d076e1848: creating. {{(pid=83122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 19:37:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:46 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Creating offline snapshot 0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da of volume 0c56025e-a87b-4b0e-bc39-30c2a4aec9ff {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:37:46 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2da442-0595-4bbf-a2f7-2d98bb41f2c9]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" returned: 0 in 0.828s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:47 devstack quobyte-client[83143]: System call of process 91852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:47 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=32, name=volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:37:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da 1G" returned: 0 in 0.450s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] CMD "qemu-img rebase -u -b volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" returned: 0 in 0.191s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:37:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" returned: 0 in 0.119s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" returned: 0 in 0.126s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.info" returned: 0 in 0.106s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.info" returned: 0 in 0.126s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:49 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-73b9e2fc-e34c-4f89-b1df-649772b85a5f tempest-GroupSnapshotsV319Test-1289141563 None] group_snapshot b320542f-d3dd-4079-b186-038d076e1848: created successfully
Sep 17 19:37:50 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] group_snapshot b320542f-d3dd-4079-b186-038d076e1848: deleting
Sep 17 19:37:50 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] group_snapshot b320542f-d3dd-4079-b186-038d076e1848: deleting {{(pid=83122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Acquiring lock "cinder-quobyte-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "cinder-quobyte-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" acquired by "delete_snapshot" :: waited 0.071s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Acquiring lock "cinder-quobyte-0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "cinder-quobyte-0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Deleting offline snapshot 0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da of volume 0c56025e-a87b-4b0e-bc39-30c2a4aec9ff {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] snapshot_file for this snap is: volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9826f32-8bc9-4009-afaf-6045aa2eacaf]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" returned: 0 in 0.442s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:37:51 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d1ff6-ec7d-44a4-bbb0-bc5b29ab08ac]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" returned: 0 in 0.518s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:51 devstack quobyte-client[83143]: System call of process 91868 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:37:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" returned: 0 in 0.265s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff.0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" returned: 0 in 0.113s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "cinder-quobyte-0c43bf8a-4b9c-4d0c-8cb3-8ba1af96e9da" released by "_delete_snapshot" :: held 1.687s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "cinder-quobyte-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" released by "delete_snapshot" :: held 1.716s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:52 devstack cinder-volume[83122]: WARNING cinder.quota [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1423270291 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1423270291, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:52 devstack cinder-volume[83122]: WARNING cinder.quota [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1423270291 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1423270291, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:52 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] Created reservations ['ee2c6f90-df54-4cc1-bafc-03f768d7f0cf', '329af672-b683-4ca1-89f7-41deeb1d505b', '3962b132-af62-436f-96ee-0de043a39703', '5a82063e-5180-434d-8830-22f2596985da'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:52 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-42e689b8-7078-4e2b-845f-20595cfd7675 tempest-GroupSnapshotsV319Test-1289141563 None] group_snapshot b320542f-d3dd-4079-b186-038d076e1848: deleted successfully
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.111s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:37:54 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:37:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Acquiring lock "cinder-quobyte-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:37:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "cinder-quobyte-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" acquired by "delete_volume" :: waited 0.060s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:37:54 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb3f291-cf00-4247-97cd-032041705743]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:37:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" returned: 0 in 0.441s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" returned: 0 in 0.146s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "cinder-quobyte-0c56025e-a87b-4b0e-bc39-30c2a4aec9ff" released by "delete_volume" :: held 0.759s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:37:55 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Created reservations ['3a546c93-b80f-4696-b351-d9bc38c4ce62'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:55 devstack cinder-volume[83122]: WARNING cinder.quota [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1423270291 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1423270291, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:37:55 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Created reservations ['6b6eea68-73f0-4eae-b6be-9bab42b7abfe', '3091eb4c-3598-4705-b0a2-6c875047b1db', '06c7d97c-b622-4a3c-aba1-441bc9f220fc', 'f5c60733-c1b1-49cb-a828-05a3386e153b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:37:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:37:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:37:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:37:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:37:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:37:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:37:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.154s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:37:56 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:37:56 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3be2cbe5-31cc-4c9d-927d-b2730e89eeb9 tempest-GroupSnapshotsV319Test-1289141563 None] Delete group completed successfully.
Sep 17 19:38:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-74c2b58e-1bfc-4812-80e8-5fc451c0655f req-b248d587-731c-401e-97a9-2e8d0de566ef tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-74c2b58e-1bfc-4812-80e8-5fc451c0655f req-b248d587-731c-401e-97a9-2e8d0de566ef tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:00 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-74c2b58e-1bfc-4812-80e8-5fc451c0655f req-b248d587-731c-401e-97a9-2e8d0de566ef tempest-AttachVolumeTestJSON-344252043 None] Terminate volume connection completed successfully.
Sep 17 19:38:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-74c2b58e-1bfc-4812-80e8-5fc451c0655f req-b248d587-731c-401e-97a9-2e8d0de566ef tempest-AttachVolumeTestJSON-344252043 None] Deleting attachment 43358a3a-4cdd-4255-8c64-51c47fc8e500. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:38:10 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=47,cinder:SELECT=59,cinder:DELETE=2,cinder:INSERT=8 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:38:10 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=47,cinder:SELECT=49,cinder:DELETE=1,cinder:INSERT=10 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:38:21 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Flow 'volume_create_manager' (18abe63b-7cde-4983-9e4a-5bc2ed982538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c2fefe-688f-4da9-9b80-7d31fb1eda9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c2fefe-688f-4da9-9b80-7d31fb1eda9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-212361761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a485dd2-ea6c-4db4-a483-826c33fe2b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0ab0df08424fd48de289e27ca6a884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:38:21Z,use_quota=True,user_id='5a23130bdf2f4595bb9907cf618c3e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6239562e-7e2d-431d-aba6-096de0c90503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6239562e-7e2d-431d-aba6-096de0c90503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50bf7a83-f254-4071-83c0-76dbf37273b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50bf7a83-f254-4071-83c0-76dbf37273b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a485dd2-ea6c-4db4-a483-826c33fe2b5b', 'volume_name': 'volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f82c2-ba29-49cf-94ba-caa45c063348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f82c2-ba29-49cf-94ba-caa45c063348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90403943-2561-4ca2-974b-dd3aba25e059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:38:21 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b', 'volume_size': 1}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-212361761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a485dd2-ea6c-4db4-a483-826c33fe2b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0ab0df08424fd48de289e27ca6a884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:38:21Z,use_quota=True,user_id='5a23130bdf2f4595bb9907cf618c3e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Creating volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:38:21 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:38:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:21 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=34, name=volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b 1073741824" returned: 0 in 0.446s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" returned: 0 in 0.155s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] <== create_volume: return (675ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90403943-2561-4ca2-974b-dd3aba25e059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ce692c-88e5-4cb5-bc89-2cc24877be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:38:22 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Volume volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b (0a485dd2-ea6c-4db4-a483-826c33fe2b5b): created successfully
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ce692c-88e5-4cb5-bc89-2cc24877be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:38:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Flow 'volume_create_manager' (18abe63b-7cde-4983-9e4a-5bc2ed982538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:38:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1b23a6ca-52fa-4f62-9bed-96ec0087def9 tempest-SnapshotsActionsTest-1599752729 None] Created volume successfully.
Sep 17 19:38:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:38:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:38:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Creating offline snapshot 0a82a17e-a4b5-43fa-8e54-2e4486560375 of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:38:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6e1bed-d43f-467d-aa58-f3ad0e043cf4]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:38:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:24 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-3b26c98a-b9de-40b8-b98f-234acef55423 req-cbf185fe-cc77-488a-8615-1d4003118fdd tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:25 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-3b26c98a-b9de-40b8-b98f-234acef55423 req-cbf185fe-cc77-488a-8615-1d4003118fdd tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:25 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-3b26c98a-b9de-40b8-b98f-234acef55423 req-cbf185fe-cc77-488a-8615-1d4003118fdd tempest-AttachVolumeTestJSON-344252043 None] Terminate volume connection completed successfully.
Sep 17 19:38:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-3b26c98a-b9de-40b8-b98f-234acef55423 req-cbf185fe-cc77-488a-8615-1d4003118fdd tempest-AttachVolumeTestJSON-344252043 None] Deleting attachment 26860755-ffc6-4600-becf-972c803d1979. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:38:25 devstack quobyte-client[83143]: System call of process 92035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:38:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" returned: 0 in 1.824s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:26 devstack quobyte-client[83143]: System call of process 92046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:38:26 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=35, name=volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:38:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 1G" returned: 0 in 0.952s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.272s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:38:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.315s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:38:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.381s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.info" returned: 0 in 0.278s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:38:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.info" returned: 0 in 0.247s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.500s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:38:30 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0a2da607-a75a-4c50-8ecb-db9580d96cf0 tempest-SnapshotsActionsTest-1599752729 None] Create snapshot completed successfully
Sep 17 19:38:33 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:38:34 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:38:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:38:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Creating offline snapshot 3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:38:34 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb92e9-9268-40c8-b71d-0d151082b876]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:38:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:35 devstack quobyte-client[83143]: System call of process 92108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:38:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 1.165s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:38:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:36 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=37, name=volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:38:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e 1G" returned: 0 in 0.766s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" returned: 0 in 0.540s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:38:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" returned: 0 in 0.207s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:38:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" returned: 0 in 0.151s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.434s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:38:38 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e65a40af-b6da-4ff1-8e31-ad0228e169b5 tempest-SnapshotsActionsTest-1599752729 None] Create snapshot completed successfully
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.309s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:39 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-quobyte-3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Deleting offline snapshot 3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] snapshot_file for this snap is: volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e9fd19-9c3b-4f97-988c-2194e08a2125]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:38:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" returned: 0 in 0.955s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:38:40 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d75c7-d2f5-4a07-b3db-faafa657a47d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:38:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.738s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:38:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" returned: 0 in 0.354s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" returned: 0 in 0.102s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e" released by "_delete_snapshot" :: held 2.652s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:38:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" released by "delete_snapshot" :: held 2.717s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:38:42 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Created reservations ['53884a93-89f9-4308-af1d-915d03bd05f1', '5927a74e-a3a6-4975-bf3d-9204a1b0a63a', '761a07b2-e4d6-4f84-a282-bf8f8ed399fb', '96eb04ea-5678-4497-8de1-1cafc13e3c97'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:38:42 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Delete snapshot completed successfully.
Sep 17 19:38:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4ddab637-eddf-499a-97e9-4c0cfaf07d0d tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-3688a2eb-7ff2-4dd3-a3dc-3d5535d7396e-delete_snapshot" released by "delete_snapshot" :: held 3.324s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:38:44 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:38:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:38:44 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Creating offline snapshot 76110f91-3d26-4bea-8632-f785c9ecc19a of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:38:44 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e306e3-2555-4fdb-9f63-336055004f0c]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:38:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:45 devstack quobyte-client[83143]: System call of process 92142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:38:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.824s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:38:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:46 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=38, name=volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:38:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a 1G" returned: 0 in 1.067s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:46 devstack quobyte-client[83143]: System call of process 92188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:38:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a" returned: 0 in 0.290s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:46 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:38:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "cinder-898958c6-7734-4c21-813d-09fea882aa5e-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a" returned: 0 in 1.409s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:38:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-898958c6-7734-4c21-813d-09fea882aa5e-delete_volume" acquired by "delete_volume" :: waited 1.173s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a" returned: 0 in 2.082s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.395s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:38:51 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:51 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "cinder-quobyte-898958c6-7734-4c21-813d-09fea882aa5e" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:51 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-quobyte-898958c6-7734-4c21-813d-09fea882aa5e" acquired by "delete_volume" :: waited 0.033s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:51 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-379f2b7f-d13c-4b32-ac8d-4ae043af1a31 tempest-SnapshotsActionsTest-1599752729 None] Create snapshot completed successfully
Sep 17 19:38:51 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6231b677-6d4f-4f32-b660-cd545b84219b]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:38:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:52 devstack quobyte-client[83143]: System call of process 92231 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:38:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e" returned: 0 in 0.959s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-76110f91-3d26-4bea-8632-f785c9ecc19a-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-898958c6-7734-4c21-813d-09fea882aa5e" returned: 0 in 1.287s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-76110f91-3d26-4bea-8632-f785c9ecc19a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.670s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.560s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-quobyte-898958c6-7734-4c21-813d-09fea882aa5e" released by "delete_volume" :: held 2.879s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" acquired by "delete_snapshot" :: waited 0.506s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-quobyte-76110f91-3d26-4bea-8632-f785c9ecc19a" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-76110f91-3d26-4bea-8632-f785c9ecc19a" acquired by "_delete_snapshot" :: waited 0.177s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Deleting offline snapshot 76110f91-3d26-4bea-8632-f785c9ecc19a of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] snapshot_file for this snap is: volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e312ba2-331b-4b20-ada4-f7a179aa72d7]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:38:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:55 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Created reservations ['820748cf-bab0-46fa-b879-dd732d7e5cd8', '5c6419a1-f74c-4079-a267-90b04b95d6ab', 'af5833b0-8c9f-402b-808c-5f4844d258eb', 'a0fb916c-a666-4751-9050-5c0d9bb02504'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:38:55 devstack quobyte-client[83143]: System call of process 92246 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a" returned: 0 in 1.301s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.296s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaecef7-36b0-4930-b074-c9eb89b7fa95]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:38:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:56 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Deleted volume successfully.
Sep 17 19:38:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "cinder-ff87eeb8-c053-4fca-b5e2-522098e40846-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:38:57 devstack quobyte-client[83143]: System call of process 92252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:38:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-ff87eeb8-c053-4fca-b5e2-522098e40846-delete_volume" acquired by "delete_volume" :: waited 0.204s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:38:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7589f609-9cd6-4bd5-b90d-2bf323b83170 tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-898958c6-7734-4c21-813d-09fea882aa5e-delete_volume" released by "delete_volume" :: held 8.293s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:38:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 1.297s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:38:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:38:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:38:58 devstack quobyte-client[83143]: System call of process 92256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "cinder-quobyte-ff87eeb8-c053-4fca-b5e2-522098e40846" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a" returned: 0 in 2.407s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.76110f91-3d26-4bea-8632-f785c9ecc19a" returned: 0 in 0.289s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-quobyte-ff87eeb8-c053-4fca-b5e2-522098e40846" acquired by "delete_volume" :: waited 0.554s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-76110f91-3d26-4bea-8632-f785c9ecc19a" released by "_delete_snapshot" :: held 6.090s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:00 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eb8725-1cb6-424d-a7eb-035d2e287068]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" released by "delete_snapshot" :: held 6.517s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:01 devstack quobyte-client[83143]: System call of process 92293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846" returned: 0 in 1.007s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Created reservations ['8c37f733-5cb7-49b4-b589-160868b085a3', '52114727-9283-411a-86e9-7a73d3dd7676', '0be124c3-6328-4fca-bf64-6c0f81f07836', '0103a9c5-c124-4f62-87cc-6bc25845b34c'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ff87eeb8-c053-4fca-b5e2-522098e40846" returned: 0 in 0.442s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-quobyte-ff87eeb8-c053-4fca-b5e2-522098e40846" released by "delete_volume" :: held 1.697s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Delete snapshot completed successfully.
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-773bf454-437d-4740-9986-da4c5b0102ce tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-76110f91-3d26-4bea-8632-f785c9ecc19a-delete_snapshot" released by "delete_snapshot" :: held 8.749s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Created reservations ['b39a80ab-c369-4a38-9b7c-8a753b62575a', '9b3c3b57-0751-4595-a5d2-015058168184', 'ef8a66a3-8fc9-4bb8-a7a4-f20957de536f', '534601e2-a832-4afe-a080-94ad798ce597'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.249s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:03 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:03 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Deleted volume successfully.
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "cinder-c6fe324e-95ab-4744-af39-5f4a2657a0d2-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-c6fe324e-95ab-4744-af39-5f4a2657a0d2-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-961d4753-c6f6-420a-bcf7-150f3b6c1e5f tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-ff87eeb8-c053-4fca-b5e2-522098e40846-delete_volume" released by "delete_volume" :: held 6.911s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Creating offline snapshot 45974d58-3965-44bc-8f30-9065727717e9 of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:39:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "cinder-quobyte-c6fe324e-95ab-4744-af39-5f4a2657a0d2" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511aedd-8a04-4da2-b656-ad9cf1f63494]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-quobyte-c6fe324e-95ab-4744-af39-5f4a2657a0d2" acquired by "delete_volume" :: waited 0.274s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:05 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d654118-5625-4f10-a8db-c5a010051363]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:05 devstack quobyte-client[83143]: System call of process 92330 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:05 devstack quobyte-client[83143]: System call of process 92330 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 1.037s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:39:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2" returned: 0 in 0.959s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:06 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=39, name=volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:39:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c6fe324e-95ab-4744-af39-5f4a2657a0d2" returned: 0 in 0.194s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 1G" returned: 0 in 0.690s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-quobyte-c6fe324e-95ab-4744-af39-5f4a2657a0d2" released by "delete_volume" :: held 1.604s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:07 devstack quobyte-client[83143]: System call of process 92349 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9" returned: 0 in 0.582s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:39:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:08 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Created reservations ['6a130ed8-aabc-4ccb-ba53-faa32aefdcbf', 'db1ecff7-111f-4dd4-8a5d-5b57f30c6a8d', '73bae415-bcb4-464c-bd1d-bb09ffdedf03', '2e4c724f-cde4-4934-8c3a-b3f4b95efdb9'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9" returned: 0 in 0.639s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:39:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9" returned: 0 in 0.625s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.279s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:09 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3ac0cb29-4b1f-4095-bbc6-ea03f936979a tempest-SnapshotsActionsTest-1599752729 None] Create snapshot completed successfully
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.256s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:09 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:09 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Deleted volume successfully.
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ae721100-8e52-464a-a62f-f7a7c2268098 tempest-AttachVolumeTestJSON-344252043 None] Lock "cinder-c6fe324e-95ab-4744-af39-5f4a2657a0d2-delete_volume" released by "delete_volume" :: held 5.706s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-45974d58-3965-44bc-8f30-9065727717e9-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-45974d58-3965-44bc-8f30-9065727717e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-quobyte-45974d58-3965-44bc-8f30-9065727717e9" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-45974d58-3965-44bc-8f30-9065727717e9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Deleting offline snapshot 45974d58-3965-44bc-8f30-9065727717e9 of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] snapshot_file for this snap is: volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e995d-0746-48d2-b3ab-c19f24d2f092]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:11 devstack quobyte-client[83143]: System call of process 92365 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9" returned: 0 in 1.094s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:39:12 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8644afe-1264-45b0-9544-27acf085bd6a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:13 devstack quobyte-client[83143]: System call of process 92371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 1.578s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:39:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:13 devstack quobyte-client[83143]: System call of process 92378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:14 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Flow 'volume_create_manager' (3966a486-b53c-442d-aa60-f81e6b64649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b6a92b-93bd-49e4-853b-f66c1b753d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b6a92b-93bd-49e4-853b-f66c1b753d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1180761517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f214ca9e-ccb2-469a-bf6e-5aac1aa259eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2a92901f984cf49153cf1c8998ab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:13Z,use_quota=True,user_id='065945b419f048eea074cf4c8861b567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be75d2ac-8091-4e34-b192-349cc864dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be75d2ac-8091-4e34-b192-349cc864dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c752c4-7ffe-4abb-a1b7-29956422a2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c752c4-7ffe-4abb-a1b7-29956422a2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f214ca9e-ccb2-469a-bf6e-5aac1aa259eb', 'volume_name': 'volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32631a06-6c5f-4b18-bf52-d04256eb89c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32631a06-6c5f-4b18-bf52-d04256eb89c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12fa33c-dc5b-49c3-a50e-135f1267beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:14 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Volume f214ca9e-ccb2-469a-bf6e-5aac1aa259eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb', 'volume_size': 1}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1180761517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f214ca9e-ccb2-469a-bf6e-5aac1aa259eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2a92901f984cf49153cf1c8998ab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:13Z,use_quota=True,user_id='065945b419f048eea074cf4c8861b567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Creating volume f214ca9e-ccb2-469a-bf6e-5aac1aa259eb {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:39:14 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:14 devstack quobyte-client[83143]: System call of process 92383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9" returned: 0 in 0.908s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:14 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=40, name=volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.45974d58-3965-44bc-8f30-9065727717e9" returned: 0 in 0.217s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb 1073741824" returned: 0 in 0.552s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-45974d58-3965-44bc-8f30-9065727717e9" released by "_delete_snapshot" :: held 4.459s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" released by "delete_snapshot" :: held 4.582s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb" returned: 0 in 0.503s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] <== create_volume: return (1084ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12fa33c-dc5b-49c3-a50e-135f1267beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740bb310-d4a5-4c4a-8e40-4dea96434b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Volume volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb (f214ca9e-ccb2-469a-bf6e-5aac1aa259eb): created successfully
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740bb310-d4a5-4c4a-8e40-4dea96434b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Flow 'volume_create_manager' (3966a486-b53c-442d-aa60-f81e6b64649f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d649f982-de7d-43bc-9955-9771c1730511 tempest-ServersNegativeTestJSON-1229901818 None] Created volume successfully.
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Created reservations ['18a9b980-0aa0-406a-a092-80fd831494e1', 'a235c859-941d-4372-ad90-1405b259c053', '874267f4-e97b-4efe-b342-f8d13de34c0d', '86ed6387-30ed-4bf2-8930-53c3e607f781'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Delete snapshot completed successfully.
Sep 17 19:39:15 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-80280088-8049-489e-a671-2160e03fd3dc tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-45974d58-3965-44bc-8f30-9065727717e9-delete_snapshot" released by "delete_snapshot" :: held 5.261s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Creating offline snapshot 862f383c-9bdb-4e0a-956d-a86be9604750 of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:39:17 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2481ec71-62d3-4682-94dd-f4bdd819c238]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 1.237s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:39:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:19 devstack quobyte-client[83143]: System call of process 92399 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:19 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=41, name=volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:39:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 1G" returned: 0 in 0.506s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img rebase -u -b volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750" returned: 0 in 0.605s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Flow 'volume_create_manager' (acd4c64f-e39f-4a0b-9d5f-48046b5b4784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba5ea6b-75c1-4d20-9476-c52b57833391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba5ea6b-75c1-4d20-9476-c52b57833391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-500260837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae265198-eda9-4b9d-abf5-7f917296bdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2a92901f984cf49153cf1c8998ab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:19Z,use_quota=True,user_id='065945b419f048eea074cf4c8861b567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f0383d-c1f0-4d83-90fc-cfbda6f526b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f0383d-c1f0-4d83-90fc-cfbda6f526b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53e961f-af36-44fc-852e-e80461dc1fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53e961f-af36-44fc-852e-e80461dc1fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae265198-eda9-4b9d-abf5-7f917296bdbe', 'volume_name': 'volume-ae265198-eda9-4b9d-abf5-7f917296bdbe', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57418914-d477-453d-8495-349ae6604732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57418914-d477-453d-8495-349ae6604732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b301bd-f898-41f5-8871-4419034f5d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:20 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Volume ae265198-eda9-4b9d-abf5-7f917296bdbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae265198-eda9-4b9d-abf5-7f917296bdbe', 'volume_size': 1}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750" returned: 0 in 0.775s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:39:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750" returned: 0 in 0.203s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.825s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-500260837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae265198-eda9-4b9d-abf5-7f917296bdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2a92901f984cf49153cf1c8998ab48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:19Z,use_quota=True,user_id='065945b419f048eea074cf4c8861b567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Creating volume ae265198-eda9-4b9d-abf5-7f917296bdbe {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:39:21 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:39:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ae265198-eda9-4b9d-abf5-7f917296bdbe 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:21 devstack quobyte-client[83143]: System call of process 92407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:21 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=42, name=volume-ae265198-eda9-4b9d-abf5-7f917296bdbe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:39:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ae265198-eda9-4b9d-abf5-7f917296bdbe 1073741824" returned: 0 in 0.725s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ae265198-eda9-4b9d-abf5-7f917296bdbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b2e446d3-eccf-4b4c-b892-58e5d4744bd4 tempest-SnapshotsActionsTest-1599752729 None] Create snapshot completed successfully
Sep 17 19:39:22 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=50,cinder:SELECT=41,cinder:DELETE=6,cinder:INSERT=13 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:39:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ae265198-eda9-4b9d-abf5-7f917296bdbe" returned: 0 in 0.605s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] <== create_volume: return (1453ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:39:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-862f383c-9bdb-4e0a-956d-a86be9604750-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b301bd-f898-41f5-8871-4419034f5d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae265198-eda9-4b9d-abf5-7f917296bdbe', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6c0cb8-6260-4cbb-baf7-118bbe6d4b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-862f383c-9bdb-4e0a-956d-a86be9604750-delete_snapshot" acquired by "delete_snapshot" :: waited 0.247s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Acquiring lock "cinder-quobyte-862f383c-9bdb-4e0a-956d-a86be9604750" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:23 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Volume volume-ae265198-eda9-4b9d-abf5-7f917296bdbe (ae265198-eda9-4b9d-abf5-7f917296bdbe): created successfully
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6c0cb8-6260-4cbb-baf7-118bbe6d4b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Flow 'volume_create_manager' (acd4c64f-e39f-4a0b-9d5f-48046b5b4784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-862f383c-9bdb-4e0a-956d-a86be9604750" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Deleting offline snapshot 862f383c-9bdb-4e0a-956d-a86be9604750 of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] snapshot_file for this snap is: volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64b8665-03aa-4b96-8f62-49d15b9b9af6]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4c7c570a-de18-41cd-8ed6-74466d96a6ca tempest-ServersNegativeTestJSON-1229901818 None] Created volume successfully.
Sep 17 19:39:24 devstack quobyte-client[83143]: System call of process 92412 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750" returned: 0 in 0.903s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:39:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42c082f-ff37-4e51-9b9c-b4b4fcc0c469]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.926s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:25 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:39:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "cinder-ae265198-eda9-4b9d-abf5-7f917296bdbe-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750" returned: 0 in 0.471s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Lock "cinder-ae265198-eda9-4b9d-abf5-7f917296bdbe-delete_volume" acquired by "delete_volume" :: waited 0.343s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.862f383c-9bdb-4e0a-956d-a86be9604750" returned: 0 in 0.475s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-862f383c-9bdb-4e0a-956d-a86be9604750" released by "_delete_snapshot" :: held 3.178s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:26 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "cinder-quobyte-ae265198-eda9-4b9d-abf5-7f917296bdbe" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" released by "delete_snapshot" :: held 3.308s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Lock "cinder-quobyte-ae265198-eda9-4b9d-abf5-7f917296bdbe" acquired by "delete_volume" :: waited 0.072s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:26 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[766f49e2-89be-406e-8c38-81423f9ef489]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ae265198-eda9-4b9d-abf5-7f917296bdbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ae265198-eda9-4b9d-abf5-7f917296bdbe" returned: 0 in 0.759s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ae265198-eda9-4b9d-abf5-7f917296bdbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ae265198-eda9-4b9d-abf5-7f917296bdbe" returned: 0 in 0.208s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:27 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Created reservations ['215136c4-ebeb-4831-ae72-e390f1f6d7f2', '516022e9-57af-44a4-ba06-de5946b61f88', 'c668f85d-82f4-45bc-b90f-fb6e60f01a0c', '560a9bff-f3fa-4980-94ef-043d01d98a8b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Lock "cinder-quobyte-ae265198-eda9-4b9d-abf5-7f917296bdbe" released by "delete_volume" :: held 1.321s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Delete snapshot completed successfully.
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3000ab60-ad4f-4047-b4ef-61425c6f1c2b tempest-SnapshotsActionsTest-29517041 None] Lock "cinder-862f383c-9bdb-4e0a-956d-a86be9604750-delete_snapshot" released by "delete_snapshot" :: held 5.002s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Created reservations ['7b2bbdbf-e8cf-4e60-a547-16d31a07927f', '27fc55d4-05bb-4829-a224-0cdf68bd692f', 'fbc3b041-25a9-494b-95d4-29c01496358e', 'edfafafc-a15e-4985-9f29-d3562179737e'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.373s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:28 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Deleted volume successfully.
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "cinder-0a82a17e-a4b5-43fa-8e54-2e4486560375-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:29 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Flow 'volume_create_manager' (f06703c7-f0dc-4a92-a50e-adf2fc04ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0fd2be-8125-42e3-89bc-47a265d7f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0fd2be-8125-42e3-89bc-47a265d7f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1981827900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a6ed76-2c6b-4c47-b59e-084a6d3649f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2be3eed5216e46eface4e541287b3160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:29Z,use_quota=True,user_id='e681f676cdda43fdb726ae8d7f97d1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad5984b-9a9e-4a07-8bb2-4f9fa3bd5801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad5984b-9a9e-4a07-8bb2-4f9fa3bd5801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0a8c24-1c83-41ee-9a48-1cab36adedd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0a8c24-1c83-41ee-9a48-1cab36adedd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a6ed76-2c6b-4c47-b59e-084a6d3649f9', 'volume_name': 'volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48e12d0-215d-4cd7-aae8-26e4edcf8f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48e12d0-215d-4cd7-aae8-26e4edcf8f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6f3ea4-bfa5-4f75-80d7-ccac83f68342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:29 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Volume 03a6ed76-2c6b-4c47-b59e-084a6d3649f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9', 'volume_size': 1}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1981827900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a6ed76-2c6b-4c47-b59e-084a6d3649f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2be3eed5216e46eface4e541287b3160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:29Z,use_quota=True,user_id='e681f676cdda43fdb726ae8d7f97d1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Creating volume 03a6ed76-2c6b-4c47-b59e-084a6d3649f9 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:39:29 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "cinder-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:29 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=43, name=volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c9d1a30d-7634-4164-ac6b-58bd8e164e27 tempest-ServersNegativeTestJSON-1229901818 None] Lock "cinder-ae265198-eda9-4b9d-abf5-7f917296bdbe-delete_volume" released by "delete_volume" :: held 4.006s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-0a82a17e-a4b5-43fa-8e54-2e4486560375-delete_snapshot" acquired by "delete_snapshot" :: waited 0.678s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:30 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Lock "cinder-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb-delete_volume" acquired by "delete_volume" :: waited 0.301s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9 1073741824" returned: 0 in 0.595s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" acquired by "delete_snapshot" :: waited 0.316s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "cinder-quobyte-0a82a17e-a4b5-43fa-8e54-2e4486560375" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:30 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "cinder-quobyte-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9" returned: 0 in 0.446s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] <== create_volume: return (1057ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-quobyte-0a82a17e-a4b5-43fa-8e54-2e4486560375" acquired by "_delete_snapshot" :: waited 0.292s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Deleting offline snapshot 0a82a17e-a4b5-43fa-8e54-2e4486560375 of volume 0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] snapshot_file for this snap is: volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ba457-5cad-4a3c-8150-635bbc71242a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Lock "cinder-quobyte-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb" acquired by "delete_volume" :: waited 0.111s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6f3ea4-bfa5-4f75-80d7-ccac83f68342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc8b79c-39c4-4ce4-999d-bcfca32ebbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f94b4ca-0237-43ee-b2ae-2fec6e2da6f5]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:31 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Volume volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9 (03a6ed76-2c6b-4c47-b59e-084a6d3649f9): created successfully
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc8b79c-39c4-4ce4-999d-bcfca32ebbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Flow 'volume_create_manager' (f06703c7-f0dc-4a92-a50e-adf2fc04ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.942s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:39:31 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-c10e45c3-61c9-4466-96cb-cb44e14c76ce req-4ce7f30e-7ae5-4f7a-8ac2-474acf7cc325 tempest-VolumesGetTestJSON-673320943 None] Created volume successfully.
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79433771-9d05-49a3-ba1f-312d0246fc08]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:32 devstack quobyte-client[83143]: System call of process 92439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb" returned: 0 in 0.939s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb" returned: 0 in 0.109s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Lock "cinder-quobyte-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb" released by "delete_volume" :: held 1.605s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Acquiring lock "cinder-03a6ed76-2c6b-4c47-b59e-084a6d3649f9-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" returned: 0 in 0.919s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:33 devstack quobyte-client[83143]: System call of process 92449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Lock "cinder-03a6ed76-2c6b-4c47-b59e-084a6d3649f9-delete_volume" acquired by "delete_volume" :: waited 0.351s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.374s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b.0a82a17e-a4b5-43fa-8e54-2e4486560375" returned: 0 in 0.297s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Acquiring lock "cinder-quobyte-03a6ed76-2c6b-4c47-b59e-084a6d3649f9" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-quobyte-0a82a17e-a4b5-43fa-8e54-2e4486560375" released by "_delete_snapshot" :: held 2.808s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Lock "cinder-quobyte-03a6ed76-2c6b-4c47-b59e-084a6d3649f9" acquired by "delete_volume" :: waited 0.074s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" released by "delete_snapshot" :: held 3.173s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c351f50e-40c0-4185-b8d1-61d699189da8]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=54,cinder:UPDATE=64,cinder:INSERT=16,cinder:DELETE=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Created reservations ['18f3b94d-2534-4026-ba8d-89a5cde9d1b0', '40f59eb8-a760-4029-9ef8-e2d180712a4d', 'a5e5406b-390e-42bd-a639-56ba97fc411d', '021d2219-bd52-42a9-8eac-83cedb987fc7'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9" returned: 0 in 0.534s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-03a6ed76-2c6b-4c47-b59e-084a6d3649f9" returned: 0 in 0.076s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Lock "cinder-quobyte-03a6ed76-2c6b-4c47-b59e-084a6d3649f9" released by "delete_volume" :: held 0.824s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Created reservations ['b29f2d51-2b3d-4631-9f91-e7d4d0338378', '894639d9-32bf-404a-b7e9-5f19dab4f6b9', 'e1e3f14b-19cd-45a4-862c-63bbc5f52f7b', 'bd6589ba-6224-4dc9-a28b-67c881977317'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.186s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG cinder.quota [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Created reservations ['ed5d9234-9896-4067-b417-9b236f2c8ab3', '0ac98709-46c4-4755-9248-1691e685b8ba', '46b90210-0716-418a-917a-0bd36c747ff2', '6686f241-6f82-4acf-98e5-97ab45c8618f'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Deleted volume successfully.
Sep 17 19:39:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Delete snapshot completed successfully.
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "cinder-0a485dd2-ea6c-4db4-a483-826c33fe2b5b-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62974eb6-d91b-41c1-b680-5d49a32df485 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-0a82a17e-a4b5-43fa-8e54-2e4486560375-delete_snapshot" released by "delete_snapshot" :: held 5.172s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60809df2-eb87-4cd3-bcd5-0fdc039a5128 tempest-ServersNegativeTestJSON-1229901818 None] Lock "cinder-f214ca9e-ccb2-469a-bf6e-5aac1aa259eb-delete_volume" released by "delete_volume" :: held 5.171s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-0a485dd2-ea6c-4db4-a483-826c33fe2b5b-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.414s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:36 devstack cinder-volume[83122]: DEBUG cinder.manager [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:36 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Deleted volume successfully.
Sep 17 19:39:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" acquired by "delete_volume" :: waited 0.169s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:36 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b14bc9c-d756-4d5e-985c-4a88dc3a5f1e]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-cdb11e0f-a9e7-4f39-9459-a2806a7ef901 req-bbd08c0e-0f27-41ee-be8c-2a17bb430814 tempest-VolumesGetTestJSON-673320943 None] Lock "cinder-03a6ed76-2c6b-4c47-b59e-084a6d3649f9-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:37 devstack quobyte-client[83143]: System call of process 92459 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" returned: 0 in 1.090s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" returned: 0 in 0.565s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-quobyte-0a485dd2-ea6c-4db4-a483-826c33fe2b5b" released by "delete_volume" :: held 2.122s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:38 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Created reservations ['4bb6ba2b-aa65-4949-8cad-8b8c8a493dec', '4aa988c0-eceb-4318-9134-11ad12729924', 'f34669dd-56d4-4055-86e3-0c154ed89c70', '26d3eee6-620c-4ae5-a6c1-a332ae89b107'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:38 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.126s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:39 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:39 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Deleted volume successfully.
Sep 17 19:39:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa319047-9340-4cd4-baee-84910c96d815 tempest-SnapshotsActionsTest-1599752729 None] Lock "cinder-0a485dd2-ea6c-4db4-a483-826c33fe2b5b-delete_volume" released by "delete_volume" :: held 4.303s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:43 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-8499983f-600f-4d3a-8a16-b27fdb458689 tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:43 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8499983f-600f-4d3a-8a16-b27fdb458689 tempest-GroupsTest-987670232 None] Group tempest-Group1-1788743065: creating
Sep 17 19:39:43 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8499983f-600f-4d3a-8a16-b27fdb458689 tempest-GroupsTest-987670232 None] Group tempest-Group1-1788743065: created successfully
Sep 17 19:39:43 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8499983f-600f-4d3a-8a16-b27fdb458689 tempest-GroupsTest-987670232 None] Create group completed successfully.
Sep 17 19:39:44 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b1b5a898-f70f-432d-80b4-c6989c131a10 tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:44 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b1b5a898-f70f-432d-80b4-c6989c131a10 tempest-GroupsTest-987670232 None] Group tempest-Group2-1527778154: creating
Sep 17 19:39:44 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b1b5a898-f70f-432d-80b4-c6989c131a10 tempest-GroupsTest-987670232 None] Group tempest-Group2-1527778154: created successfully
Sep 17 19:39:44 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b1b5a898-f70f-432d-80b4-c6989c131a10 tempest-GroupsTest-987670232 None] Create group completed successfully.
Sep 17 19:39:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:46 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Flow 'volume_create_manager' (ded8e182-e6e2-450e-ac2f-4a77250be2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd1e6fe-adb3-4729-943c-ad791021f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd1e6fe-adb3-4729-943c-ad791021f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1171781193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21fe76e8-0270-4221-8819-3e8d453e67a3,host='devstack@QuobyteHD#QuobyteHD',id=5deed9c7-4a58-4096-8cf7-1bc944440706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8187bb1aa8124282be8c54b82f78a83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:47Z,use_quota=True,user_id='524f00f9f78c47a7b1443e272b611611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30d32abd-f4ae-49e9-8ef6-b69964a394ae),volume_type_id=30d32abd-f4ae-49e9-8ef6-b69964a394ae)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0820ac-a1ef-4aec-8d0c-51e3d3441fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0820ac-a1ef-4aec-8d0c-51e3d3441fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f71be2f-b593-4fbb-bac0-66ec75874797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f71be2f-b593-4fbb-bac0-66ec75874797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5deed9c7-4a58-4096-8cf7-1bc944440706', 'volume_name': 'volume-5deed9c7-4a58-4096-8cf7-1bc944440706', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccc73b9-c2d5-44af-8d1e-c01dbd914873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccc73b9-c2d5-44af-8d1e-c01dbd914873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cd20fd-cfef-4ec7-b714-59090c054c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:47 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Volume 5deed9c7-4a58-4096-8cf7-1bc944440706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5deed9c7-4a58-4096-8cf7-1bc944440706', 'volume_size': 1}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=21fe76e8-0270-4221-8819-3e8d453e67a3,created_at=2025-09-17T17:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1171781193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21fe76e8-0270-4221-8819-3e8d453e67a3,host='devstack@QuobyteHD#QuobyteHD',id=5deed9c7-4a58-4096-8cf7-1bc944440706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8187bb1aa8124282be8c54b82f78a83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:47Z,use_quota=True,user_id='524f00f9f78c47a7b1443e272b611611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30d32abd-f4ae-49e9-8ef6-b69964a394ae),volume_type_id=30d32abd-f4ae-49e9-8ef6-b69964a394ae)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Creating volume 5deed9c7-4a58-4096-8cf7-1bc944440706 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:39:47 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5deed9c7-4a58-4096-8cf7-1bc944440706 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:47 devstack quobyte-client[83143]: System call of process 92514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:39:47 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=44, name=volume-5deed9c7-4a58-4096-8cf7-1bc944440706, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5deed9c7-4a58-4096-8cf7-1bc944440706 1073741824" returned: 0 in 0.429s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5deed9c7-4a58-4096-8cf7-1bc944440706 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5deed9c7-4a58-4096-8cf7-1bc944440706" returned: 0 in 0.200s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] <== create_volume: return (727ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:39:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cd20fd-cfef-4ec7-b714-59090c054c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5deed9c7-4a58-4096-8cf7-1bc944440706', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c881ca7-b285-490d-b324-7064f0a6bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:48 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Volume volume-5deed9c7-4a58-4096-8cf7-1bc944440706 (5deed9c7-4a58-4096-8cf7-1bc944440706): created successfully
Sep 17 19:39:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c881ca7-b285-490d-b324-7064f0a6bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Flow 'volume_create_manager' (ded8e182-e6e2-450e-ac2f-4a77250be2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:48 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1693f104-9738-40fa-95c7-30dd01c0fa9a tempest-GroupsTest-987670232 None] Created volume successfully.
Sep 17 19:39:50 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Acquiring lock "cinder-quobyte-5deed9c7-4a58-4096-8cf7-1bc944440706" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:39:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Lock "cinder-quobyte-5deed9c7-4a58-4096-8cf7-1bc944440706" acquired by "delete_volume" :: waited 0.107s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:39:50 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d335463-e4dd-48d4-acfc-49f2bcf29e61]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:39:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5deed9c7-4a58-4096-8cf7-1bc944440706 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5deed9c7-4a58-4096-8cf7-1bc944440706" returned: 0 in 0.687s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5deed9c7-4a58-4096-8cf7-1bc944440706 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5deed9c7-4a58-4096-8cf7-1bc944440706" returned: 0 in 0.160s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:51 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Lock "cinder-quobyte-5deed9c7-4a58-4096-8cf7-1bc944440706" released by "delete_volume" :: held 1.124s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:39:51 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Created reservations ['e71312c3-2e87-4f1b-b4a9-89d7f7598f05'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:51 devstack cinder-volume[83122]: WARNING cinder.quota [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1459055138 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1459055138, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:39:51 devstack cinder-volume[83122]: WARNING cinder.quota [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1459055138 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1459055138, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:39:51 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Created reservations ['6de95504-14d9-4a6a-b012-ef383b56b01c', 'acfdf85e-e78c-47b9-8859-475ae458047f', '26129763-f92a-43fa-86ab-2735b831aeb5', '2c3b85e0-eeea-4052-ad65-278be8468228'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.254s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:52 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:52 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c573eb1f-e645-4993-a50f-bac384e59efa tempest-GroupsTest-987670232 None] Delete group completed successfully.
Sep 17 19:39:52 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Created reservations ['aa452ac5-a2bd-469c-8494-d554242a4076'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.099s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:53 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-dfd7d519-bf2c-4069-a091-f633c96de544 tempest-GroupsTest-987670232 None] Delete group completed successfully.
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.220s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:39:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-404dc70c-4428-4f17-835a-df107b43c46e tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-404dc70c-4428-4f17-835a-df107b43c46e tempest-GroupsTest-987670232 None] Group tempest-GroupsTest-Group-1103134407: creating
Sep 17 19:39:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-404dc70c-4428-4f17-835a-df107b43c46e tempest-GroupsTest-987670232 None] Group tempest-GroupsTest-Group-1103134407: created successfully
Sep 17 19:39:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-404dc70c-4428-4f17-835a-df107b43c46e tempest-GroupsTest-987670232 None] Create group completed successfully.
Sep 17 19:39:56 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:39:56 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:39:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Flow 'volume_create_manager' (883701fa-6a7e-488a-b93f-c1b5002d2f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb8bc2d-53b4-48d8-9bf3-a0fd98cc0e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb8bc2d-53b4-48d8-9bf3-a0fd98cc0e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-189267183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=43890042-01a4-499c-8035-22e92d29d98e,host='devstack@QuobyteHD#QuobyteHD',id=b9c48ec9-37f0-4123-a046-e89b15e7c932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8187bb1aa8124282be8c54b82f78a83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:57Z,use_quota=True,user_id='524f00f9f78c47a7b1443e272b611611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7700f13-a534-485d-beac-da086a207682),volume_type_id=a7700f13-a534-485d-beac-da086a207682)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f75e17d-4afe-47ed-afcb-88a222e8fa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f75e17d-4afe-47ed-afcb-88a222e8fa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523bab88-850b-493b-9bc4-960e2815878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523bab88-850b-493b-9bc4-960e2815878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c48ec9-37f0-4123-a046-e89b15e7c932', 'volume_name': 'volume-b9c48ec9-37f0-4123-a046-e89b15e7c932', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa31493b-a096-435d-ae94-63e367de96ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa31493b-a096-435d-ae94-63e367de96ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8971eef-d7d9-47e7-958e-e7bf3efc95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:57 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Volume b9c48ec9-37f0-4123-a046-e89b15e7c932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c48ec9-37f0-4123-a046-e89b15e7c932', 'volume_size': 1}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=43890042-01a4-499c-8035-22e92d29d98e,created_at=2025-09-17T17:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-189267183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=43890042-01a4-499c-8035-22e92d29d98e,host='devstack@QuobyteHD#QuobyteHD',id=b9c48ec9-37f0-4123-a046-e89b15e7c932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8187bb1aa8124282be8c54b82f78a83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:39:57Z,use_quota=True,user_id='524f00f9f78c47a7b1443e272b611611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7700f13-a534-485d-beac-da086a207682),volume_type_id=a7700f13-a534-485d-beac-da086a207682)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Creating volume b9c48ec9-37f0-4123-a046-e89b15e7c932 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:39:57 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b9c48ec9-37f0-4123-a046-e89b15e7c932 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:57 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=45, name=volume-b9c48ec9-37f0-4123-a046-e89b15e7c932, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b9c48ec9-37f0-4123-a046-e89b15e7c932 1073741824" returned: 0 in 0.421s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b9c48ec9-37f0-4123-a046-e89b15e7c932 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b9c48ec9-37f0-4123-a046-e89b15e7c932" returned: 0 in 0.207s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] <== create_volume: return (732ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:39:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:39:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8971eef-d7d9-47e7-958e-e7bf3efc95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c48ec9-37f0-4123-a046-e89b15e7c932', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86232a03-14ca-46ea-8076-116966d14b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:39:58 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Volume volume-b9c48ec9-37f0-4123-a046-e89b15e7c932 (b9c48ec9-37f0-4123-a046-e89b15e7c932): created successfully
Sep 17 19:39:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86232a03-14ca-46ea-8076-116966d14b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:39:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Flow 'volume_create_manager' (883701fa-6a7e-488a-b93f-c1b5002d2f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:39:58 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d8e1e7b1-6745-467e-9b1d-6d7a531458ba tempest-GroupsTest-987670232 None] Created volume successfully.
Sep 17 19:40:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Flow 'volume_create_manager' (467463cd-324c-408c-bcc9-cc4a1cda7df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f543ab8a-62e5-44e4-926f-1eb434efccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f543ab8a-62e5-44e4-926f-1eb434efccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1158634779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=43890042-01a4-499c-8035-22e92d29d98e,host='devstack@QuobyteHD#QuobyteHD',id=98553c6f-3f53-4107-8fa3-914518a12296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8187bb1aa8124282be8c54b82f78a83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:40:00Z,use_quota=True,user_id='524f00f9f78c47a7b1443e272b611611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7700f13-a534-485d-beac-da086a207682),volume_type_id=a7700f13-a534-485d-beac-da086a207682)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd777d41-b5a9-4844-b6eb-d0ec885bf579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd777d41-b5a9-4844-b6eb-d0ec885bf579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f82b58-7140-46b5-aaf2-caea7483df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f82b58-7140-46b5-aaf2-caea7483df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98553c6f-3f53-4107-8fa3-914518a12296', 'volume_name': 'volume-98553c6f-3f53-4107-8fa3-914518a12296', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99bcb82-6b35-4607-b667-b361e887c986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99bcb82-6b35-4607-b667-b361e887c986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3df5a8-460a-48cd-ad02-49b9b78d7697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:40:00 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Volume 98553c6f-3f53-4107-8fa3-914518a12296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98553c6f-3f53-4107-8fa3-914518a12296', 'volume_size': 1}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=43890042-01a4-499c-8035-22e92d29d98e,created_at=2025-09-17T17:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1158634779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=43890042-01a4-499c-8035-22e92d29d98e,host='devstack@QuobyteHD#QuobyteHD',id=98553c6f-3f53-4107-8fa3-914518a12296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8187bb1aa8124282be8c54b82f78a83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:40:00Z,use_quota=True,user_id='524f00f9f78c47a7b1443e272b611611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7700f13-a534-485d-beac-da086a207682),volume_type_id=a7700f13-a534-485d-beac-da086a207682)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Creating volume 98553c6f-3f53-4107-8fa3-914518a12296 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:40:00 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-98553c6f-3f53-4107-8fa3-914518a12296 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:00 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=46, name=volume-98553c6f-3f53-4107-8fa3-914518a12296, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-98553c6f-3f53-4107-8fa3-914518a12296 1073741824" returned: 0 in 0.525s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-98553c6f-3f53-4107-8fa3-914518a12296 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-98553c6f-3f53-4107-8fa3-914518a12296" returned: 0 in 0.326s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] <== create_volume: return (1000ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:40:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:40:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3df5a8-460a-48cd-ad02-49b9b78d7697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98553c6f-3f53-4107-8fa3-914518a12296', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:40:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f3e998-821a-4a58-a574-534253610848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:40:01 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Volume volume-98553c6f-3f53-4107-8fa3-914518a12296 (98553c6f-3f53-4107-8fa3-914518a12296): created successfully
Sep 17 19:40:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f3e998-821a-4a58-a574-534253610848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:40:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Flow 'volume_create_manager' (467463cd-324c-408c-bcc9-cc4a1cda7df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:40:01 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-584b649f-893e-419b-92af-69b32aa9b742 tempest-GroupsTest-987670232 None] Created volume successfully.
Sep 17 19:40:02 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-79fb935b-d0f7-4c4c-89c1-efa9808698e7 tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:40:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-79fb935b-d0f7-4c4c-89c1-efa9808698e7 tempest-GroupsTest-987670232 None] Update group completed successfully.
Sep 17 19:40:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-5f090674-56ff-4270-85ac-99e9783d92d3 tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:40:04 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-5f090674-56ff-4270-85ac-99e9783d92d3 tempest-GroupsTest-987670232 None] Update group completed successfully.
Sep 17 19:40:05 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:40:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Acquiring lock "cinder-quobyte-98553c6f-3f53-4107-8fa3-914518a12296" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:40:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Lock "cinder-quobyte-98553c6f-3f53-4107-8fa3-914518a12296" acquired by "delete_volume" :: waited 0.065s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:40:05 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb78e5fb-e0c3-4000-8ed5-b5156da2043f]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:40:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-98553c6f-3f53-4107-8fa3-914518a12296 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:06 devstack quobyte-client[83143]: System call of process 92572 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:40:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-98553c6f-3f53-4107-8fa3-914518a12296" returned: 0 in 0.618s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-98553c6f-3f53-4107-8fa3-914518a12296 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-98553c6f-3f53-4107-8fa3-914518a12296" returned: 0 in 0.224s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Lock "cinder-quobyte-98553c6f-3f53-4107-8fa3-914518a12296" released by "delete_volume" :: held 1.110s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:40:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Acquiring lock "cinder-quobyte-b9c48ec9-37f0-4123-a046-e89b15e7c932" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:40:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Lock "cinder-quobyte-b9c48ec9-37f0-4123-a046-e89b15e7c932" acquired by "delete_volume" :: waited 0.057s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:40:07 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c1e22c-a9fe-4dde-a4ec-e06674412e15]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:40:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b9c48ec9-37f0-4123-a046-e89b15e7c932 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b9c48ec9-37f0-4123-a046-e89b15e7c932" returned: 0 in 0.589s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b9c48ec9-37f0-4123-a046-e89b15e7c932 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b9c48ec9-37f0-4123-a046-e89b15e7c932" returned: 0 in 0.166s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Lock "cinder-quobyte-b9c48ec9-37f0-4123-a046-e89b15e7c932" released by "delete_volume" :: held 1.093s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:40:08 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Created reservations ['c02181e2-114c-4afc-84ff-a29113256b3a'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:40:08 devstack cinder-volume[83122]: WARNING cinder.quota [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-787896528 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-787896528, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:40:08 devstack cinder-volume[83122]: WARNING cinder.quota [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-787896528 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-787896528, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:40:08 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Created reservations ['f362f9a2-04eb-479b-8d1d-307a50db1f62', 'a469f315-a7f9-4135-9f51-09375e40a39b', '31e485d0-47e1-48c9-92e7-f6f8694c6036', '6da731cb-a882-4318-815f-82ef7faff9b2'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:40:08 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Created reservations ['9a623d70-21e9-4822-8013-b46ab6c31b0d', '2cd081a9-66bd-43e5-a98d-2394088b7fa1', '6e956e0a-7d03-4242-8e0c-e8a6735c9e6e', '5e375fa8-acbf-4fad-8a9e-57ca27cfd4f4'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:40:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:40:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:40:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:40:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:40:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:40:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.125s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:09 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:40:09 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-9709bce2-600d-4fcb-9d46-afbc274197bc tempest-GroupsTest-987670232 None] Delete group completed successfully.
Sep 17 19:40:19 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:INSERT=14,cinder:UPDATE=59,cinder:SELECT=55,cinder:DELETE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:40:19 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:DELETE=7,cinder:UPDATE=104,cinder:SELECT=68,cinder:INSERT=20 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:40:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4e4e37b7-5d44-4e6c-89c1-0598886d26da tempest-GroupsV320Test-1124110435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:40:20 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4e4e37b7-5d44-4e6c-89c1-0598886d26da tempest-GroupsV320Test-1124110435 None] Group tempest-GroupsV320Test-Group-1794879044: creating
Sep 17 19:40:20 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4e4e37b7-5d44-4e6c-89c1-0598886d26da tempest-GroupsV320Test-1124110435 None] Group tempest-GroupsV320Test-Group-1794879044: created successfully
Sep 17 19:40:20 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4e4e37b7-5d44-4e6c-89c1-0598886d26da tempest-GroupsV320Test-1124110435 None] Create group completed successfully.
Sep 17 19:40:22 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Created reservations ['2eabc9e3-e981-4253-a737-16bcffe027fc'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.118s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:22 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:40:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f19c1f58-2525-4d74-adaa-d3af499349ba tempest-GroupsV320Test-1124110435 None] Delete group completed successfully.
Sep 17 19:40:32 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:40:32 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.321s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:40:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:41:01 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Flow 'volume_create_manager' (d257e6dc-806d-458e-9978-6fca8ee22018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ff92cb-3e06-422a-a169-7b4cfc57dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ff92cb-3e06-422a-a169-7b4cfc57dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2086033097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f23ef0b-205a-4459-a94b-b8fe6641341e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641c813d7d9c4c969e1577feb32f7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:01Z,use_quota=True,user_id='5da15c4d7eac4508abb7afe574561422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289ae71b-51b9-4392-ac44-bea4442c5ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289ae71b-51b9-4392-ac44-bea4442c5ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a1a80e-7e47-411f-a6eb-e79e61d455c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a1a80e-7e47-411f-a6eb-e79e61d455c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f23ef0b-205a-4459-a94b-b8fe6641341e', 'volume_name': 'volume-6f23ef0b-205a-4459-a94b-b8fe6641341e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4794ac51-bdef-4cb0-8e8e-4a5f0f1026d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4794ac51-bdef-4cb0-8e8e-4a5f0f1026d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83943db-263b-476b-b09e-a83229e5a8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:01 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume 6f23ef0b-205a-4459-a94b-b8fe6641341e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f23ef0b-205a-4459-a94b-b8fe6641341e', 'volume_size': 1}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2086033097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f23ef0b-205a-4459-a94b-b8fe6641341e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641c813d7d9c4c969e1577feb32f7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:01Z,use_quota=True,user_id='5da15c4d7eac4508abb7afe574561422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Creating volume 6f23ef0b-205a-4459-a94b-b8fe6641341e {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:41:01 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:41:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6f23ef0b-205a-4459-a94b-b8fe6641341e 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:02 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=47, name=volume-6f23ef0b-205a-4459-a94b-b8fe6641341e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:41:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6f23ef0b-205a-4459-a94b-b8fe6641341e 1073741824" returned: 0 in 1.221s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6f23ef0b-205a-4459-a94b-b8fe6641341e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6f23ef0b-205a-4459-a94b-b8fe6641341e" returned: 0 in 0.605s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] <== create_volume: return (2170ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:41:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83943db-263b-476b-b09e-a83229e5a8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f23ef0b-205a-4459-a94b-b8fe6641341e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dad13a0-6643-4744-85a7-41e42944af57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:04 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume volume-6f23ef0b-205a-4459-a94b-b8fe6641341e (6f23ef0b-205a-4459-a94b-b8fe6641341e): created successfully
Sep 17 19:41:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dad13a0-6643-4744-85a7-41e42944af57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Flow 'volume_create_manager' (d257e6dc-806d-458e-9978-6fca8ee22018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:04 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-aa85ee9b-2926-469d-b71d-104c0b31f296 tempest-VolumeQuotasAdminTestJSON-12627699 None] Created volume successfully.
Sep 17 19:41:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Acquiring lock "cinder-6f23ef0b-205a-4459-a94b-b8fe6641341e-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "cinder-6f23ef0b-205a-4459-a94b-b8fe6641341e-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:06 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Acquiring lock "cinder-quobyte-6f23ef0b-205a-4459-a94b-b8fe6641341e" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "cinder-quobyte-6f23ef0b-205a-4459-a94b-b8fe6641341e" acquired by "delete_volume" :: waited 0.031s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:06 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[54156518-267c-427d-bf15-4368e36588ef]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:41:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6f23ef0b-205a-4459-a94b-b8fe6641341e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6f23ef0b-205a-4459-a94b-b8fe6641341e" returned: 0 in 0.912s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6f23ef0b-205a-4459-a94b-b8fe6641341e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6f23ef0b-205a-4459-a94b-b8fe6641341e" returned: 0 in 0.155s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "cinder-quobyte-6f23ef0b-205a-4459-a94b-b8fe6641341e" released by "delete_volume" :: held 1.422s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Created reservations ['11eed383-4c60-4475-85e0-04f69a9dbc38', 'bbbc6445-4581-45c9-86a6-da7b5886a948', 'c9ab9f58-407b-4ba4-b3af-9c5161380bbd', '435153cd-7f05-4027-a873-e4aecf5e58bb'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.141s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:41:08 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Deleted volume successfully.
Sep 17 19:41:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9bcfebba-38bd-4cc0-b203-5c3ed15b0c13 tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "cinder-6f23ef0b-205a-4459-a94b-b8fe6641341e-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Flow 'volume_create_manager' (8212df41-611a-45e4-a04d-d22dbc20e577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071e9216-3e46-4565-82ef-8d87ded67eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071e9216-3e46-4565-82ef-8d87ded67eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1485377270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be58a5c3-79fd-422f-adbd-7a1652526940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641c813d7d9c4c969e1577feb32f7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:09Z,use_quota=True,user_id='5da15c4d7eac4508abb7afe574561422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77672453-d994-4b76-9df1-b2de1e6c152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77672453-d994-4b76-9df1-b2de1e6c152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10ba525-e565-4e25-a29b-d09651ffcdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10ba525-e565-4e25-a29b-d09651ffcdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be58a5c3-79fd-422f-adbd-7a1652526940', 'volume_name': 'volume-be58a5c3-79fd-422f-adbd-7a1652526940', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9a216d-6cb5-453d-9af9-8a2a8e0fc1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9a216d-6cb5-453d-9af9-8a2a8e0fc1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3732638e-d4db-4102-a0de-8771c00748d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:09 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume be58a5c3-79fd-422f-adbd-7a1652526940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be58a5c3-79fd-422f-adbd-7a1652526940', 'volume_size': 1}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1485377270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be58a5c3-79fd-422f-adbd-7a1652526940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641c813d7d9c4c969e1577feb32f7d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:09Z,use_quota=True,user_id='5da15c4d7eac4508abb7afe574561422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Creating volume be58a5c3-79fd-422f-adbd-7a1652526940 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:41:09 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:41:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-be58a5c3-79fd-422f-adbd-7a1652526940 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:09 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=48, name=volume-be58a5c3-79fd-422f-adbd-7a1652526940, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-be58a5c3-79fd-422f-adbd-7a1652526940 1073741824" returned: 0 in 0.531s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-be58a5c3-79fd-422f-adbd-7a1652526940 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-be58a5c3-79fd-422f-adbd-7a1652526940" returned: 0 in 0.162s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] <== create_volume: return (777ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3732638e-d4db-4102-a0de-8771c00748d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be58a5c3-79fd-422f-adbd-7a1652526940', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643e52ba-fa06-4bc1-b22e-31b65b447173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:10 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Volume volume-be58a5c3-79fd-422f-adbd-7a1652526940 (be58a5c3-79fd-422f-adbd-7a1652526940): created successfully
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643e52ba-fa06-4bc1-b22e-31b65b447173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Flow 'volume_create_manager' (8212df41-611a-45e4-a04d-d22dbc20e577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:10 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-76a50a59-8232-45a9-b246-4c8c32834a9d tempest-VolumeQuotasAdminTestJSON-12627699 None] Created volume successfully.
Sep 17 19:41:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a75e5500-3146-4e12-8735-d80f74d71f1b tempest-VolumeQuotasAdminTestJSON-807976410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:12 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a75e5500-3146-4e12-8735-d80f74d71f1b tempest-VolumeQuotasAdminTestJSON-807976410 None] Transfer volume completed successfully.
Sep 17 19:41:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Acquiring lock "cinder-be58a5c3-79fd-422f-adbd-7a1652526940-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Lock "cinder-be58a5c3-79fd-422f-adbd-7a1652526940-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:13 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Acquiring lock "cinder-quobyte-be58a5c3-79fd-422f-adbd-7a1652526940" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Lock "cinder-quobyte-be58a5c3-79fd-422f-adbd-7a1652526940" acquired by "delete_volume" :: waited 0.027s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:13 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2036ca-4430-4bd7-82bd-333792c075b4]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:41:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-be58a5c3-79fd-422f-adbd-7a1652526940 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-be58a5c3-79fd-422f-adbd-7a1652526940" returned: 0 in 0.636s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-be58a5c3-79fd-422f-adbd-7a1652526940 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-be58a5c3-79fd-422f-adbd-7a1652526940" returned: 0 in 0.142s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:14 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Lock "cinder-quobyte-be58a5c3-79fd-422f-adbd-7a1652526940" released by "delete_volume" :: held 1.014s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:15 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Created reservations ['ab994215-25b1-47ea-9376-728dd94068de', '70abe921-7305-4f2e-9062-181d5960346c', 'da2bce11-ee14-45c9-801f-dc97d3c3683b', 'bd19e2a7-4fcc-4818-8254-5bed53bd4d1a'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:41:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.584s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:16 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:41:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Deleted volume successfully.
Sep 17 19:41:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9d742bc-369a-4e4e-847a-4feeff55b792 tempest-VolumeQuotasAdminTestJSON-346365819 None] Lock "cinder-be58a5c3-79fd-422f-adbd-7a1652526940-delete_volume" released by "delete_volume" :: held 4.162s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:25 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:41:26 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:26 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:41:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (c3f98655-0e77-4fe8-b955-006481d7d921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356aff27-e585-4523-b5d5-fa3141ada0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356aff27-e585-4523-b5d5-fa3141ada0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1224547485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7e4d62-cd9e-4e96-86ca-3af197a49d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:27Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d7876e-780a-4696-9614-8884bbbac3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d7876e-780a-4696-9614-8884bbbac3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b5899e-7425-478f-8490-6ffa38825c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b5899e-7425-478f-8490-6ffa38825c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7e4d62-cd9e-4e96-86ca-3af197a49d4e', 'volume_name': 'volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679c333d-64f8-4e3c-9fb7-cddc00e78e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679c333d-64f8-4e3c-9fb7-cddc00e78e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09930da-6573-45bc-ad97-1753766b753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:27 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Volume fc7e4d62-cd9e-4e96-86ca-3af197a49d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e', 'volume_size': 1}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1224547485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7e4d62-cd9e-4e96-86ca-3af197a49d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:27Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Creating volume fc7e4d62-cd9e-4e96-86ca-3af197a49d4e {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:41:27 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:27 devstack quobyte-client[83143]: System call of process 92878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:41:27 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=49, name=volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e 1073741824" returned: 0 in 0.512s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" returned: 0 in 0.109s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] <== create_volume: return (717ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:41:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09930da-6573-45bc-ad97-1753766b753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82904a42-dc87-4f3e-835f-f8b168ce460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:28 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Volume volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e (fc7e4d62-cd9e-4e96-86ca-3af197a49d4e): created successfully
Sep 17 19:41:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82904a42-dc87-4f3e-835f-f8b168ce460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (c3f98655-0e77-4fe8-b955-006481d7d921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-12c2c3aa-1fe7-4a1c-8473-90e5f2697e4b tempest-VolumesActionsTest-1250966298 None] Created volume successfully.
Sep 17 19:41:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f7d9e9a6-75c8-4fee-a7ac-acb192cecf6f tempest-VolumesActionsTest-1250966298 None] Acquiring lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" by "attach_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f7d9e9a6-75c8-4fee-a7ac-acb192cecf6f tempest-VolumesActionsTest-1250966298 None] Lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" acquired by "attach_volume" :: waited 0.056s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:29 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f7d9e9a6-75c8-4fee-a7ac-acb192cecf6f tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:29 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f7d9e9a6-75c8-4fee-a7ac-acb192cecf6f tempest-VolumesActionsTest-1250966298 None] Attaching volume fc7e4d62-cd9e-4e96-86ca-3af197a49d4e to instance d7125864-20a8-4750-8435-0e2186b63dc4 at mountpoint /dev/vdb on host None.
Sep 17 19:41:29 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f7d9e9a6-75c8-4fee-a7ac-acb192cecf6f tempest-VolumesActionsTest-1250966298 None] Attach volume completed successfully.
Sep 17 19:41:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f7d9e9a6-75c8-4fee-a7ac-acb192cecf6f tempest-VolumesActionsTest-1250966298 None] Lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" released by "attach_volume" :: held 0.478s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:30 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:30 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Terminate volume connection completed successfully.
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-detach_volume" by "detach_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Flow 'volume_create_manager' (426f93bd-83d2-4577-a242-647d20971efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffbf0c1-c1e1-4035-abd8-14fc2c5ff1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffbf0c1-c1e1-4035-abd8-14fc2c5ff1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1637319631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753873c3-72aa-478d-bc6a-f1589ce8ef67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d72528aaab4ca299b53611283c2d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:31Z,use_quota=True,user_id='5e2c510bc24841d99f0a4eae11286c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1b556bd-385f-4098-9dce-3ecb60ad6cd7),volume_type_id=c1b556bd-385f-4098-9dce-3ecb60ad6cd7)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518d429a-8794-4e3e-a79e-ba21b764f1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518d429a-8794-4e3e-a79e-ba21b764f1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed511714-2fd1-49b3-aac5-7a8a73b90819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed511714-2fd1-49b3-aac5-7a8a73b90819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753873c3-72aa-478d-bc6a-f1589ce8ef67', 'volume_name': 'volume-753873c3-72aa-478d-bc6a-f1589ce8ef67', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be29e3a0-5b83-477d-9f9e-471123548d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be29e3a0-5b83-477d-9f9e-471123548d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d212c7-cc57-47ad-851b-de4e0d5728c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:31 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Volume 753873c3-72aa-478d-bc6a-f1589ce8ef67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753873c3-72aa-478d-bc6a-f1589ce8ef67', 'volume_size': 1}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1637319631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753873c3-72aa-478d-bc6a-f1589ce8ef67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d72528aaab4ca299b53611283c2d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:31Z,use_quota=True,user_id='5e2c510bc24841d99f0a4eae11286c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1b556bd-385f-4098-9dce-3ecb60ad6cd7),volume_type_id=c1b556bd-385f-4098-9dce-3ecb60ad6cd7)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Creating volume 753873c3-72aa-478d-bc6a-f1589ce8ef67 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:41:31 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-753873c3-72aa-478d-bc6a-f1589ce8ef67 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:31 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=50, name=volume-753873c3-72aa-478d-bc6a-f1589ce8ef67, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:41:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:31 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Detaching volume fc7e4d62-cd9e-4e96-86ca-3af197a49d4e from instance d7125864-20a8-4750-8435-0e2186b63dc4.
Sep 17 19:41:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-753873c3-72aa-478d-bc6a-f1589ce8ef67 1073741824" returned: 0 in 0.472s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-753873c3-72aa-478d-bc6a-f1589ce8ef67 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-753873c3-72aa-478d-bc6a-f1589ce8ef67" returned: 0 in 0.193s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] <== create_volume: return (702ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:41:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d212c7-cc57-47ad-851b-de4e0d5728c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753873c3-72aa-478d-bc6a-f1589ce8ef67', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdc25ae-759c-431e-9540-44065543b9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:32 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Volume volume-753873c3-72aa-478d-bc6a-f1589ce8ef67 (753873c3-72aa-478d-bc6a-f1589ce8ef67): created successfully
Sep 17 19:41:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdc25ae-759c-431e-9540-44065543b9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Flow 'volume_create_manager' (426f93bd-83d2-4577-a242-647d20971efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:32 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Detach volume completed successfully.
Sep 17 19:41:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0fecd204-b416-415e-96d8-9498a8e07931 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-detach_volume" released by "detach_volume" :: held 1.053s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:32 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c8bdacfb-3a52-49c7-a96d-eda19ec5ca8e tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Created volume successfully.
Sep 17 19:41:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-91fe51d9-c1f5-4b79-a3f6-e91c64e5bf33 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-detach_volume" by "detach_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-91fe51d9-c1f5-4b79-a3f6-e91c64e5bf33 tempest-VolumesActionsTest-1250966298 None] Lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:32 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-91fe51d9-c1f5-4b79-a3f6-e91c64e5bf33 tempest-VolumesActionsTest-1250966298 None] Volume detach called, but volume not attached.
Sep 17 19:41:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-91fe51d9-c1f5-4b79-a3f6-e91c64e5bf33 tempest-VolumesActionsTest-1250966298 None] Lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Acquiring lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:34 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Acquiring lock "cinder-quobyte-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Lock "cinder-quobyte-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" acquired by "delete_volume" :: waited 0.022s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:34 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ecdc8a-d5cb-4b8a-8930-bb63a6be8b26]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:41:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:34 devstack quobyte-client[83143]: System call of process 92887 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.089s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" returned: 0 in 1.194s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.352s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:41:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e489810c-ccf3-405c-8d93-bf69935c31fd tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Retype volume completed successfully.
Sep 17 19:41:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Acquiring lock "cinder-753873c3-72aa-478d-bc6a-f1589ce8ef67-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" returned: 0 in 0.651s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Lock "cinder-quobyte-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e" released by "delete_volume" :: held 2.244s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "cinder-753873c3-72aa-478d-bc6a-f1589ce8ef67-delete_volume" acquired by "delete_volume" :: waited 0.495s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:36 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Acquiring lock "cinder-quobyte-753873c3-72aa-478d-bc6a-f1589ce8ef67" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "cinder-quobyte-753873c3-72aa-478d-bc6a-f1589ce8ef67" acquired by "delete_volume" :: waited 0.025s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:36 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[019727ec-3663-4ece-bcc7-c971bdca3e48]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:41:36 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Created reservations ['5abaf6ed-f251-4fcc-b7d8-1a5b9db6c46e', 'fd4327cf-68d1-43bc-80be-6340463ecbdb', 'eabd1dd0-ed49-48ca-ae69-d95de167e792', 'e087bf76-301a-495e-ad45-193e5970100d'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:41:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-753873c3-72aa-478d-bc6a-f1589ce8ef67 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.053s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:37 devstack quobyte-client[83143]: System call of process 92893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:41:37 devstack quobyte-client[83143]: System call of process 92893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:41:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-753873c3-72aa-478d-bc6a-f1589ce8ef67" returned: 0 in 1.248s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-753873c3-72aa-478d-bc6a-f1589ce8ef67 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.596s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:38 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:41:38 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Deleted volume successfully.
Sep 17 19:41:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-753873c3-72aa-478d-bc6a-f1589ce8ef67" returned: 0 in 0.928s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "cinder-quobyte-753873c3-72aa-478d-bc6a-f1589ce8ef67" released by "delete_volume" :: held 2.411s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-32845702-7249-42a0-b286-766fecdd1a1f tempest-VolumesActionsTest-1250966298 None] Lock "cinder-fc7e4d62-cd9e-4e96-86ca-3af197a49d4e-delete_volume" released by "delete_volume" :: held 5.429s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:39 devstack cinder-volume[83122]: WARNING cinder.quota [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:41:39 devstack cinder-volume[83122]: WARNING cinder.quota [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:41:39 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Created reservations ['a9f1a9e3-3b9d-499a-96bb-1e738101dc6c', '539b6931-e9e5-4d38-b6ba-fe5541cd6023', '09f083a3-0874-43c4-b60e-3f3a2daa0287', '88b7bef8-4b7f-4066-bd19-0efe5fe11c58'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:41:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.860s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:41 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:41:41 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Deleted volume successfully.
Sep 17 19:41:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4bf56afe-f5c5-4eb3-87d6-d51b9799e696 tempest-VolumeRetypeWithoutMigrationTest-2086430910 None] Lock "cinder-753873c3-72aa-478d-bc6a-f1589ce8ef67-delete_volume" released by "delete_volume" :: held 5.502s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:49 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:49 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:41:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (8e7a1570-904b-41ad-bf72-0df784d5803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b586ce-8b84-4ec3-8536-ae0d42d3aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b586ce-8b84-4ec3-8536-ae0d42d3aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-688865703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:49Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54610a54-6e84-469b-944f-c88e5a92cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54610a54-6e84-469b-944f-c88e5a92cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e544239e-9e5c-4c40-b6d3-3d2c695ade3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e544239e-9e5c-4c40-b6d3-3d2c695ade3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8', 'volume_name': 'volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89acc2ca-ca82-4fa2-9ad2-975d1692eda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89acc2ca-ca82-4fa2-9ad2-975d1692eda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111ba901-f267-466c-9274-90044b5efaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:50 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Volume 7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8', 'volume_size': 1}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-688865703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:49Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Creating volume 7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:41:50 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:50 devstack quobyte-client[83143]: System call of process 92962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:41:50 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=51, name=volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8 1073741824" returned: 0 in 0.677s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8" returned: 0 in 0.358s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] <== create_volume: return (1233ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:41:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111ba901-f267-466c-9274-90044b5efaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c3fd07-f348-4e7e-9d78-02543899de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:51 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Volume volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8 (7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8): created successfully
Sep 17 19:41:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c3fd07-f348-4e7e-9d78-02543899de22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (8e7a1570-904b-41ad-bf72-0df784d5803e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:51 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-817d82d6-a107-4877-9a1f-e04aba834290 tempest-VolumesActionsTest-1250966298 None] Created volume successfully.
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Lock "cinder-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=59,cinder:SELECT=34,cinder:INSERT=12,cinder:DELETE=5 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:41:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-quobyte-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Lock "cinder-quobyte-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8" acquired by "delete_volume" :: waited 0.018s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d97924-c3a8-4780-a12c-841daf0e3e1e]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:54 devstack quobyte-client[83143]: System call of process 92970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:41:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.597s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8" returned: 0 in 1.109s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:41:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8" returned: 0 in 0.315s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Lock "cinder-quobyte-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8" released by "delete_volume" :: held 1.617s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Created reservations ['d2446dad-10dd-44f8-b6df-768aa53b2eb6', '7feddc9b-bff3-4df4-bb58-8b6db008cb98', '81789251-a38b-4718-b4ba-eb45a577712e', '8fff6474-3f15-4780-93fa-dc327d840d20'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.169s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:41:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Deleted volume successfully.
Sep 17 19:41:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-12228c73-304d-4ca9-89bc-efa45f346dde tempest-VolumesActionsTest-1779618439 None] Lock "cinder-7bea8d5b-f8e0-4f2f-b8f9-c4ec892838a8-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:41:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (52df70fc-bcb1-4a2c-a119-884483cf466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46268316-5a02-4eb9-bee3-2777316c989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46268316-5a02-4eb9-bee3-2777316c989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-587637124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c42f7bb-b28a-4e6f-bca8-41b33f833edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:57Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6265c954-1d7e-4b28-a44b-5799205e5089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6265c954-1d7e-4b28-a44b-5799205e5089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62beb817-a3a2-488b-80ac-4324677e3c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62beb817-a3a2-488b-80ac-4324677e3c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c42f7bb-b28a-4e6f-bca8-41b33f833edf', 'volume_name': 'volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdfc9d0-5d1b-41a8-82f2-4019a1289663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdfc9d0-5d1b-41a8-82f2-4019a1289663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63f2a41-df5a-4f5e-9579-290da0869b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:57 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Volume 2c42f7bb-b28a-4e6f-bca8-41b33f833edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf', 'volume_size': 1}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-587637124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c42f7bb-b28a-4e6f-bca8-41b33f833edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:57Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Creating volume 2c42f7bb-b28a-4e6f-bca8-41b33f833edf {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:41:57 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:41:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:58 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=52, name=volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:41:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf 1073741824" returned: 0 in 0.562s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf" returned: 0 in 0.275s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:41:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] <== create_volume: return (991ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:41:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63f2a41-df5a-4f5e-9579-290da0869b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458a5057-4da5-4504-8396-6d74fecf4ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:59 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Volume volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf (2c42f7bb-b28a-4e6f-bca8-41b33f833edf): created successfully
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458a5057-4da5-4504-8396-6d74fecf4ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (52df70fc-bcb1-4a2c-a119-884483cf466f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:59 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b67ea515-3004-4679-b75d-e69c876e75cb tempest-VolumesActionsTest-1250966298 None] Created volume successfully.
Sep 17 19:41:59 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Flow 'volume_create_manager' (6e7cd764-364a-4127-bb23-a7c3182dd2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573fe067-a3e2-41cd-8ff4-580a08da9b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573fe067-a3e2-41cd-8ff4-580a08da9b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-177505675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d429cb09-877d-423b-b698-7e8c54f49fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc774e5279cd49ae9ba0f4b247631856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:59Z,use_quota=True,user_id='d846be0f4d7d430aad9f4ead0735779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e957a7f4-0304-4657-96b6-ee3b681d1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e957a7f4-0304-4657-96b6-ee3b681d1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b649da-f3c8-40fc-b09a-16a35103c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b649da-f3c8-40fc-b09a-16a35103c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd429cb09-877d-423b-b698-7e8c54f49fd8', 'volume_name': 'volume-d429cb09-877d-423b-b698-7e8c54f49fd8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8915b9-7d84-4feb-9e20-057fe04042ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8915b9-7d84-4feb-9e20-057fe04042ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d2e707-3086-48f8-8e6a-207e7d536c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:41:59 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Volume d429cb09-877d-423b-b698-7e8c54f49fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d429cb09-877d-423b-b698-7e8c54f49fd8', 'volume_size': 1}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-177505675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d429cb09-877d-423b-b698-7e8c54f49fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc774e5279cd49ae9ba0f4b247631856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:41:59Z,use_quota=True,user_id='d846be0f4d7d430aad9f4ead0735779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Creating volume d429cb09-877d-423b-b698-7e8c54f49fd8 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:41:59 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:41:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:41:59 devstack quobyte-client[83143]: System call of process 92982 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:41:59 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=53, name=volume-d429cb09-877d-423b-b698-7e8c54f49fd8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-2c42f7bb-b28a-4e6f-bca8-41b33f833edf-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8 1073741824" returned: 0 in 0.639s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-2c42f7bb-b28a-4e6f-bca8-41b33f833edf-delete_volume" acquired by "delete_volume" :: waited 0.223s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8" returned: 0 in 0.311s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] <== create_volume: return (987ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d2e707-3086-48f8-8e6a-207e7d536c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d429cb09-877d-423b-b698-7e8c54f49fd8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58c6b7b-9ac0-4211-97fd-da145949b1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-quobyte-2c42f7bb-b28a-4e6f-bca8-41b33f833edf" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:00 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Volume volume-d429cb09-877d-423b-b698-7e8c54f49fd8 (d429cb09-877d-423b-b698-7e8c54f49fd8): created successfully
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58c6b7b-9ac0-4211-97fd-da145949b1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Flow 'volume_create_manager' (6e7cd764-364a-4127-bb23-a7c3182dd2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-quobyte-2c42f7bb-b28a-4e6f-bca8-41b33f833edf" acquired by "delete_volume" :: waited 0.072s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:00 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a829589f-9c15-4f8a-a7d7-646df2ef5808 tempest-AttachVolumeNegativeTest-1241069812 None] Created volume successfully.
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d504f2-10c3-4358-b9e4-76a2bf52cb4f]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:42:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:01 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Flow 'volume_create_manager' (0a3f7016-9040-4ef7-890d-736891e88716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae48831-2880-400f-8dcc-a0e172b5a876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae48831-2880-400f-8dcc-a0e172b5a876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-894614415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f192201c-f397-4111-8786-6a8982573683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc23a2915634b488d318337040240ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:01Z,use_quota=True,user_id='28fe8c739c36454fa86dfecd6f7f38ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(208c9311-e6f4-43f3-a96c-e8ffeeb72a7f),volume_type_id=208c9311-e6f4-43f3-a96c-e8ffeeb72a7f)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92b0210-8e19-402e-91ff-54c873311177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92b0210-8e19-402e-91ff-54c873311177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4667e31-db2c-41f3-b11b-da257ad31229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4667e31-db2c-41f3-b11b-da257ad31229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f192201c-f397-4111-8786-6a8982573683', 'volume_name': 'volume-f192201c-f397-4111-8786-6a8982573683', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a834a6cb-e0da-49ef-b1e3-d4a394df5937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a834a6cb-e0da-49ef-b1e3-d4a394df5937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b5e90e-6738-4414-968d-a95fbf08be1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:01 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Volume f192201c-f397-4111-8786-6a8982573683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f192201c-f397-4111-8786-6a8982573683', 'volume_size': 1}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-894614415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f192201c-f397-4111-8786-6a8982573683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc23a2915634b488d318337040240ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:01Z,use_quota=True,user_id='28fe8c739c36454fa86dfecd6f7f38ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(208c9311-e6f4-43f3-a96c-e8ffeeb72a7f),volume_type_id=208c9311-e6f4-43f3-a96c-e8ffeeb72a7f)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Creating volume f192201c-f397-4111-8786-6a8982573683 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:42:01 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f192201c-f397-4111-8786-6a8982573683 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:01 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=54, name=volume-f192201c-f397-4111-8786-6a8982573683, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf" returned: 0 in 0.767s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f192201c-f397-4111-8786-6a8982573683 1073741824" returned: 0 in 0.412s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f192201c-f397-4111-8786-6a8982573683 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2c42f7bb-b28a-4e6f-bca8-41b33f833edf" returned: 0 in 0.241s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f192201c-f397-4111-8786-6a8982573683" returned: 0 in 0.150s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] <== create_volume: return (607ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:42:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.618s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-quobyte-2c42f7bb-b28a-4e6f-bca8-41b33f833edf" released by "delete_volume" :: held 1.386s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b5e90e-6738-4414-968d-a95fbf08be1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f192201c-f397-4111-8786-6a8982573683', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4e83e8-a321-4410-bac0-0ca73d52bfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Created reservations ['6ad9c32d-6941-4c84-86a7-118d16bc17e8', '33ed5e21-b4ce-49d9-bfe4-cef0479503d1', '53cc05f0-8edb-4250-bb77-f27050bef160', '8ce75ba4-6405-4caf-b27c-47c811425794'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:42:02 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Volume volume-f192201c-f397-4111-8786-6a8982573683 (f192201c-f397-4111-8786-6a8982573683): created successfully
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4e83e8-a321-4410-bac0-0ca73d52bfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Flow 'volume_create_manager' (0a3f7016-9040-4ef7-890d-736891e88716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2d873e41-7200-4b36-bc82-00da006de8ba tempest-VolumeTypesAccessTest-1772030875 None] Created volume successfully.
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.138s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:42:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Deleted volume successfully.
Sep 17 19:42:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cab36231-a6c3-481f-bb55-b026580d3114 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-2c42f7bb-b28a-4e6f-bca8-41b33f833edf-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Acquiring lock "cinder-f192201c-f397-4111-8786-6a8982573683-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Lock "cinder-f192201c-f397-4111-8786-6a8982573683-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:03 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Acquiring lock "cinder-quobyte-f192201c-f397-4111-8786-6a8982573683" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Lock "cinder-quobyte-f192201c-f397-4111-8786-6a8982573683" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef1966-9cc5-455e-ad20-ebb066aa8fd4]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f192201c-f397-4111-8786-6a8982573683 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f192201c-f397-4111-8786-6a8982573683" returned: 0 in 0.517s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f192201c-f397-4111-8786-6a8982573683 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f192201c-f397-4111-8786-6a8982573683" returned: 0 in 0.117s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Lock "cinder-quobyte-f192201c-f397-4111-8786-6a8982573683" released by "delete_volume" :: held 0.819s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:04 devstack cinder-volume[83122]: WARNING cinder.quota [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-296021304 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-296021304, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:42:04 devstack cinder-volume[83122]: WARNING cinder.quota [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-296021304 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-296021304, it is now deprecated. Please use the default quota class for default quota.
Sep 17 19:42:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (e07dd055-bfd6-4a42-ac8f-945a0447ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7324f235-601d-45a6-a42a-fb7cd30dd4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7324f235-601d-45a6-a42a-fb7cd30dd4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1174087007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577710ba-7b6f-4a06-b18f-fb28a1c825d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:04Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141decc8-aa82-40b4-8daf-3c7c5e7afe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141decc8-aa82-40b4-8daf-3c7c5e7afe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45a0c4f-50fe-4d86-9e45-fec3e4af53f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45a0c4f-50fe-4d86-9e45-fec3e4af53f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577710ba-7b6f-4a06-b18f-fb28a1c825d3', 'volume_name': 'volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60641c4-c57b-456b-b4d4-2ca5e3d2b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60641c4-c57b-456b-b4d4-2ca5e3d2b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadd4d97-90ab-430a-bcbc-524295b11d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:04 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Volume 577710ba-7b6f-4a06-b18f-fb28a1c825d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3', 'volume_size': 1}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1174087007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577710ba-7b6f-4a06-b18f-fb28a1c825d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:04Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Creating volume 577710ba-7b6f-4a06-b18f-fb28a1c825d3 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:42:04 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:42:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:05 devstack quobyte-client[83143]: System call of process 93037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:42:05 devstack quobyte-client[83143]: System call of process 93037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:42:05 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=55, name=volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:42:05 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Created reservations ['371efa0c-4265-406e-8122-5180166c151d', '4d9e5832-69d4-4468-b178-be55f952c6ba', 'ed52672d-f6cf-4300-b670-64e276d76c01', '6e2d40ee-878a-4a05-a0f0-8cf1c70a5ccc'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:42:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3 1073741824" returned: 0 in 0.870s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3" returned: 0 in 0.513s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] <== create_volume: return (1432ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-71b98df6-35a2-4fa0-bd07-0758c1bd6909 req-ae637cfe-0d30-4965-8376-04bf31b555ba tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-71b98df6-35a2-4fa0-bd07-0758c1bd6909 req-ae637cfe-0d30-4965-8376-04bf31b555ba tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b86038-ec56-4b34-bcee-c5c1feae6019]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-71b98df6-35a2-4fa0-bd07-0758c1bd6909 req-ae637cfe-0d30-4965-8376-04bf31b555ba tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadd4d97-90ab-430a-bcbc-524295b11d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245d8f65-02f3-403d-aa1d-1d10b31549ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:06 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Volume volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3 (577710ba-7b6f-4a06-b18f-fb28a1c825d3): created successfully
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245d8f65-02f3-403d-aa1d-1d10b31549ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (e07dd055-bfd6-4a42-ac8f-945a0447ce37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:07 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7036db4e-caf9-40f0-a515-0e783d79da90 tempest-VolumesActionsTest-1250966298 None] Created volume successfully.
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-71b98df6-35a2-4fa0-bd07-0758c1bd6909 req-ae637cfe-0d30-4965-8376-04bf31b555ba tempest-AttachVolumeNegativeTest-1241069812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8" returned: 0 in 0.777s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-71b98df6-35a2-4fa0-bd07-0758c1bd6909 req-ae637cfe-0d30-4965-8376-04bf31b555ba tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.825s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.371s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:42:07 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Deleted volume successfully.
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-71b98df6-35a2-4fa0-bd07-0758c1bd6909 req-ae637cfe-0d30-4965-8376-04bf31b555ba tempest-AttachVolumeNegativeTest-1241069812 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-d429cb09-877d-423b-b698-7e8c54f49fd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47f7f7d2-7aab-44fa-a0a4-a6bfc6e0976c', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:42:07 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-71b98df6-35a2-4fa0-bd07-0758c1bd6909 req-ae637cfe-0d30-4965-8376-04bf31b555ba tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-325feb9a-800b-48a2-8ac2-d56a6287a337 tempest-VolumeTypesAccessTest-1772030875 None] Lock "cinder-f192201c-f397-4111-8786-6a8982573683-delete_volume" released by "delete_volume" :: held 4.268s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:07 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-71b98df6-35a2-4fa0-bd07-0758c1bd6909 req-ae637cfe-0d30-4965-8376-04bf31b555ba tempest-AttachVolumeNegativeTest-1241069812 None] attachment_update completed successfully.
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-577710ba-7b6f-4a06-b18f-fb28a1c825d3-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-577710ba-7b6f-4a06-b18f-fb28a1c825d3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:07 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-quobyte-577710ba-7b6f-4a06-b18f-fb28a1c825d3" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-quobyte-577710ba-7b6f-4a06-b18f-fb28a1c825d3" acquired by "delete_volume" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:08 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c450b84-9453-4e49-9a5b-ae7a689652da]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:42:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3" returned: 0 in 0.625s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-577710ba-7b6f-4a06-b18f-fb28a1c825d3" returned: 0 in 0.105s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-quobyte-577710ba-7b6f-4a06-b18f-fb28a1c825d3" released by "delete_volume" :: held 0.909s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Created reservations ['9c994016-95ae-43da-a2aa-db1a4254e5d9', '7b3b9211-ff73-4e23-a918-467bfe07f4f6', 'c7f7077c-649d-4973-b90d-2c914d336665', 'b48e2363-148c-44ed-a631-344bba396c60'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.245s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:09 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:42:09 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Deleted volume successfully.
Sep 17 19:42:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5270fefe-4e76-4663-ac81-c338892f4df4 tempest-VolumesActionsTest-1779618439 None] Lock "cinder-577710ba-7b6f-4a06-b18f-fb28a1c825d3-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:11 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (0cf6d318-58c7-4fb0-886a-43698ad909b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8eb7582-2d88-482d-950e-1b1fe84a6690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8eb7582-2d88-482d-950e-1b1fe84a6690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1236250954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd4aa11-0db3-4977-8d30-9a829ac72150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:11Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64bf6188-0565-447f-9b11-89bd1d1ede79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64bf6188-0565-447f-9b11-89bd1d1ede79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd0e06b-f1ff-4a96-8959-a41cc45da1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd0e06b-f1ff-4a96-8959-a41cc45da1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd4aa11-0db3-4977-8d30-9a829ac72150', 'volume_name': 'volume-6bd4aa11-0db3-4977-8d30-9a829ac72150', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62e9f44-ce4d-4097-8b0f-ecba3d395a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62e9f44-ce4d-4097-8b0f-ecba3d395a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7d3645-b0a0-4659-99f3-547e9250f72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:11 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Volume 6bd4aa11-0db3-4977-8d30-9a829ac72150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd4aa11-0db3-4977-8d30-9a829ac72150', 'volume_size': 1}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1236250954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd4aa11-0db3-4977-8d30-9a829ac72150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:11Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Creating volume 6bd4aa11-0db3-4977-8d30-9a829ac72150 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:42:11 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6bd4aa11-0db3-4977-8d30-9a829ac72150 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:11 devstack quobyte-client[83143]: System call of process 93443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:42:11 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=56, name=volume-6bd4aa11-0db3-4977-8d30-9a829ac72150, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6bd4aa11-0db3-4977-8d30-9a829ac72150 1073741824" returned: 0 in 0.357s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6bd4aa11-0db3-4977-8d30-9a829ac72150 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6bd4aa11-0db3-4977-8d30-9a829ac72150" returned: 0 in 0.099s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] <== create_volume: return (572ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:42:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.584s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7d3645-b0a0-4659-99f3-547e9250f72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd4aa11-0db3-4977-8d30-9a829ac72150', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f10d5ed-8869-47f7-8535-7dd4ab22d6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:12 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Volume volume-6bd4aa11-0db3-4977-8d30-9a829ac72150 (6bd4aa11-0db3-4977-8d30-9a829ac72150): created successfully
Sep 17 19:42:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f10d5ed-8869-47f7-8535-7dd4ab22d6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (0cf6d318-58c7-4fb0-886a-43698ad909b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:12 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-12178414-b482-4984-885f-db54abce69a2 tempest-VolumesActionsTest-1250966298 None] Created volume successfully.
Sep 17 19:42:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-6bd4aa11-0db3-4977-8d30-9a829ac72150-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Lock "cinder-6bd4aa11-0db3-4977-8d30-9a829ac72150-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:13 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Acquiring lock "cinder-quobyte-6bd4aa11-0db3-4977-8d30-9a829ac72150" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Lock "cinder-quobyte-6bd4aa11-0db3-4977-8d30-9a829ac72150" acquired by "delete_volume" :: waited 0.013s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:13 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d762af8e-c9f9-4e2c-81f9-357189d76c0c]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:42:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6bd4aa11-0db3-4977-8d30-9a829ac72150 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6bd4aa11-0db3-4977-8d30-9a829ac72150" returned: 0 in 0.534s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6bd4aa11-0db3-4977-8d30-9a829ac72150 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6bd4aa11-0db3-4977-8d30-9a829ac72150" returned: 0 in 0.146s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:14 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Lock "cinder-quobyte-6bd4aa11-0db3-4977-8d30-9a829ac72150" released by "delete_volume" :: held 0.866s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Created reservations ['2fd1f140-f0b9-46d0-a637-44df5698ca90', 'a307dd00-b71f-41f3-8629-d0770bef8660', '9f96d945-e8c6-4178-bf17-109267b87d41', 'dc9ea6c5-ba2b-43e2-b9c1-40ddccc2943b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.096s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:42:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Deleted volume successfully.
Sep 17 19:42:15 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-06996145-3d0e-4de9-aa56-047a509d5caf tempest-VolumesActionsTest-1779618439 None] Lock "cinder-6bd4aa11-0db3-4977-8d30-9a829ac72150-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (b4f75e15-5e80-44f1-b8f8-2ef51a1a426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1480343b-ea38-4437-8fff-99f87950b1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1480343b-ea38-4437-8fff-99f87950b1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-992213902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f69f848-e845-4427-b5bd-688654e22252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:17Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e6d941-eaab-4658-8c64-f0384ad49488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e6d941-eaab-4658-8c64-f0384ad49488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e903da-c3c9-4973-9ecf-1ef6fca795c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e903da-c3c9-4973-9ecf-1ef6fca795c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f69f848-e845-4427-b5bd-688654e22252', 'volume_name': 'volume-8f69f848-e845-4427-b5bd-688654e22252', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc195631-48c5-472c-b6ab-9affd3a166b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc195631-48c5-472c-b6ab-9affd3a166b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d878683-d3db-4061-b4fa-62f1a12a728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Volume 8f69f848-e845-4427-b5bd-688654e22252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f69f848-e845-4427-b5bd-688654e22252', 'volume_size': 1}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-992213902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f69f848-e845-4427-b5bd-688654e22252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57288695fc044b089e263eec6e6ec2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:17Z,use_quota=True,user_id='ddb9edc485c64730b8e98363b5f8fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Creating volume 8f69f848-e845-4427-b5bd-688654e22252 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:42:17 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8f69f848-e845-4427-b5bd-688654e22252 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:17 devstack quobyte-client[83143]: System call of process 93453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:42:17 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=57, name=volume-8f69f848-e845-4427-b5bd-688654e22252, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8f69f848-e845-4427-b5bd-688654e22252 1073741824" returned: 0 in 0.350s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8f69f848-e845-4427-b5bd-688654e22252 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8f69f848-e845-4427-b5bd-688654e22252" returned: 0 in 0.113s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:42:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d878683-d3db-4061-b4fa-62f1a12a728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f69f848-e845-4427-b5bd-688654e22252', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e224954a-0fbe-4291-aa3c-e4e0e6ce0977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Volume volume-8f69f848-e845-4427-b5bd-688654e22252 (8f69f848-e845-4427-b5bd-688654e22252): created successfully
Sep 17 19:42:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e224954a-0fbe-4291-aa3c-e4e0e6ce0977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Flow 'volume_create_manager' (b4f75e15-5e80-44f1-b8f8-2ef51a1a426d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:18 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-39306c79-f97b-4344-bd45-8f51865c3327 tempest-VolumesActionsTest-1250966298 None] Created volume successfully.
Sep 17 19:42:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Acquiring lock "cinder-8f69f848-e845-4427-b5bd-688654e22252-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Lock "cinder-8f69f848-e845-4427-b5bd-688654e22252-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Acquiring lock "cinder-quobyte-8f69f848-e845-4427-b5bd-688654e22252" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Lock "cinder-quobyte-8f69f848-e845-4427-b5bd-688654e22252" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:20 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8f67bd-9090-4257-86d7-62b7f3625d4e]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:42:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8f69f848-e845-4427-b5bd-688654e22252 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8f69f848-e845-4427-b5bd-688654e22252" returned: 0 in 0.521s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8f69f848-e845-4427-b5bd-688654e22252 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8f69f848-e845-4427-b5bd-688654e22252" returned: 0 in 0.124s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Lock "cinder-quobyte-8f69f848-e845-4427-b5bd-688654e22252" released by "delete_volume" :: held 0.851s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Created reservations ['1183c1b4-28f0-4c22-a4f5-42079d11f09d', '0bc032cd-dc53-47c7-8e75-be7548eb3085', '65242555-f235-4f9e-8aeb-bd8ab6a18582', '55a4aa51-e393-4d7d-8c5d-7815f88d7fc3'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.110s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:21 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:42:21 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Deleted volume successfully.
Sep 17 19:42:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-4d329be1-c340-4e08-a5d0-41de431e011a tempest-VolumesActionsTest-1250966298 None] Lock "cinder-8f69f848-e845-4427-b5bd-688654e22252-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:42:31 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=79,cinder:UPDATE=83,cinder:DELETE=9,cinder:INSERT=21 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:42:32 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=37,cinder:INSERT=5,cinder:UPDATE=71,cinder:DELETE=5 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:42:48 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Flow 'volume_create_manager' (4039312f-46ed-4ecd-943f-fb9706a6123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e47443b-3810-449c-a294-1e0ffce2c3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e47443b-3810-449c-a294-1e0ffce2c3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1235274239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80492364-12d3-44cf-990b-8f121073525a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320e2191c88a46f797fe4f0137fbe589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:48Z,use_quota=True,user_id='039abeecf16b47408deded95a31791b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e432499b-f58f-4f6f-a6d9-d2d92bfe3736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e432499b-f58f-4f6f-a6d9-d2d92bfe3736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822ab1fd-d3a8-4271-897f-070d40d2effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822ab1fd-d3a8-4271-897f-070d40d2effe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80492364-12d3-44cf-990b-8f121073525a', 'volume_name': 'volume-80492364-12d3-44cf-990b-8f121073525a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea8f862-d5cb-4b3d-8333-de56b7cdd713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea8f862-d5cb-4b3d-8333-de56b7cdd713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c06afd-5666-4c49-94c8-f23efa124b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:48 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Volume 80492364-12d3-44cf-990b-8f121073525a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80492364-12d3-44cf-990b-8f121073525a', 'volume_size': 1}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1235274239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80492364-12d3-44cf-990b-8f121073525a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320e2191c88a46f797fe4f0137fbe589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:48Z,use_quota=True,user_id='039abeecf16b47408deded95a31791b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Creating volume 80492364-12d3-44cf-990b-8f121073525a {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:42:49 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-80492364-12d3-44cf-990b-8f121073525a 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:49 devstack quobyte-client[83143]: System call of process 93575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:42:49 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=58, name=volume-80492364-12d3-44cf-990b-8f121073525a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-80492364-12d3-44cf-990b-8f121073525a 1073741824" returned: 0 in 0.674s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-80492364-12d3-44cf-990b-8f121073525a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-80492364-12d3-44cf-990b-8f121073525a" returned: 0 in 0.421s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] <== create_volume: return (1301ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:42:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c06afd-5666-4c49-94c8-f23efa124b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80492364-12d3-44cf-990b-8f121073525a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917dbc3e-ecbc-4ecc-8fa9-9619fde857ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:51 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Volume volume-80492364-12d3-44cf-990b-8f121073525a (80492364-12d3-44cf-990b-8f121073525a): created successfully
Sep 17 19:42:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917dbc3e-ecbc-4ecc-8fa9-9619fde857ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Flow 'volume_create_manager' (4039312f-46ed-4ecd-943f-fb9706a6123d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:51 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2f3a02de-9b37-4783-8a9b-9ba59c52bf69 tempest-VolumesTransfersV357Test-1198703862 None] Created volume successfully.
Sep 17 19:42:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Flow 'volume_create_manager' (aa19f36f-9742-4931-a7a3-6d7396a3cabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71454d7-874f-49fd-8de3-debeacedefd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71454d7-874f-49fd-8de3-debeacedefd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1544256192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8dd502-26b4-493c-9c22-a9a074cfcc55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244d750786ed46248a43298bef74070d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:53Z,use_quota=True,user_id='b507b7882cbd46fba9dc39839e2fb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1126634c-4300-4bae-92ae-6e398d17a854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1126634c-4300-4bae-92ae-6e398d17a854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc5ff68-fe9e-400a-be11-e1152f37b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc5ff68-fe9e-400a-be11-e1152f37b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8dd502-26b4-493c-9c22-a9a074cfcc55', 'volume_name': 'volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156bdd9b-ac2a-488c-9555-c60a67ea29d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156bdd9b-ac2a-488c-9555-c60a67ea29d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1bd239-08df-4fed-b949-fc72be4a985a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:53 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Volume 1c8dd502-26b4-493c-9c22-a9a074cfcc55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55', 'volume_size': 1}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1544256192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8dd502-26b4-493c-9c22-a9a074cfcc55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244d750786ed46248a43298bef74070d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:42:53Z,use_quota=True,user_id='b507b7882cbd46fba9dc39839e2fb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Creating volume 1c8dd502-26b4-493c-9c22-a9a074cfcc55 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:42:53 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:42:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:54 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=59, name=volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.079s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 1073741824" returned: 0 in 0.937s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.755s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:42:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f62d6ace-5cbd-4450-a3b2-5c0c0e1ea720 tempest-VolumesTransfersV357Test-225776664 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55" returned: 0 in 0.855s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] <== create_volume: return (2083ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:42:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f62d6ace-5cbd-4450-a3b2-5c0c0e1ea720 tempest-VolumesTransfersV357Test-225776664 None] Transfer volume completed successfully.
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1bd239-08df-4fed-b949-fc72be4a985a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24b9931-c03f-4279-806b-4b9ca621a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:42:55 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Volume volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 (1c8dd502-26b4-493c-9c22-a9a074cfcc55): created successfully
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24b9931-c03f-4279-806b-4b9ca621a21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:42:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Flow 'volume_create_manager' (aa19f36f-9742-4931-a7a3-6d7396a3cabb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:42:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2ad53661-1d73-457c-a3c4-9828294764cf tempest-SnapshotMetadataTestJSON-818413420 None] Created volume successfully.
Sep 17 19:42:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:42:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:42:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Creating offline snapshot a35c391b-56a1-4924-bd39-154ace6b4cbe of volume 1c8dd502-26b4-493c-9c22-a9a074cfcc55 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:42:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb21b54b-f951-404d-8d7c-ce08e07be162]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:42:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Acquiring lock "cinder-80492364-12d3-44cf-990b-8f121073525a-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Lock "cinder-80492364-12d3-44cf-990b-8f121073525a-delete_volume" acquired by "delete_volume" :: waited 0.269s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55" returned: 0 in 1.650s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:59 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=60, name=volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:42:59 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:42:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Acquiring lock "cinder-quobyte-80492364-12d3-44cf-990b-8f121073525a" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:42:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe 1G" returned: 0 in 0.675s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:42:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:42:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Lock "cinder-quobyte-80492364-12d3-44cf-990b-8f121073525a" acquired by "delete_volume" :: waited 0.282s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:42:59 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e60b5f8-7853-41ea-b3a0-1b6bba2d28ee]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:42:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-80492364-12d3-44cf-990b-8f121073525a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "qemu-img rebase -u -b volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe" returned: 0 in 0.407s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe" returned: 0 in 0.173s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe" returned: 0 in 0.132s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:00 devstack quobyte-client[83143]: System call of process 93623 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-80492364-12d3-44cf-990b-8f121073525a" returned: 0 in 0.688s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-80492364-12d3-44cf-990b-8f121073525a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.info" returned: 0 in 0.246s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-80492364-12d3-44cf-990b-8f121073525a" returned: 0 in 0.194s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Lock "cinder-quobyte-80492364-12d3-44cf-990b-8f121073525a" released by "delete_volume" :: held 1.179s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.info" returned: 0 in 0.367s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.071s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:01 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1c3744f5-fce3-4596-8414-4c844139680e tempest-SnapshotMetadataTestJSON-818413420 None] Create snapshot completed successfully
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Created reservations ['bf5d9c1b-23cb-4298-b107-db15a4e25c17', 'c8ad892d-d8f4-4b65-b20d-ba2fc5a529f9', 'be008209-d01b-4ca9-b244-389315360bed', '9ce27e02-64de-4958-80ec-001379cb06d6'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.097s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:01 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:43:01 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Deleted volume successfully.
Sep 17 19:43:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c100beaa-c3a7-4f2b-a842-fe4b1a391cdf tempest-VolumesTransfersV357Test-853384399 None] Lock "cinder-80492364-12d3-44cf-990b-8f121073525a-delete_volume" released by "delete_volume" :: held 3.942s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:02 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Flow 'volume_create_manager' (af82b007-1416-416c-b57a-49dd263f1892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d122cbc5-05a4-4da9-ae70-eefbbbc13004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d122cbc5-05a4-4da9-ae70-eefbbbc13004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1791239976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bb8d82-3bad-489a-9f31-dad07987ddd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320e2191c88a46f797fe4f0137fbe589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:03Z,use_quota=True,user_id='039abeecf16b47408deded95a31791b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd29f86-569d-4fdc-b5d4-ff811e0d64c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd29f86-569d-4fdc-b5d4-ff811e0d64c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5157a572-6f69-44ef-b739-645893ebde2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5157a572-6f69-44ef-b739-645893ebde2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bb8d82-3bad-489a-9f31-dad07987ddd9', 'volume_name': 'volume-56bb8d82-3bad-489a-9f31-dad07987ddd9', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8b2801-8e5c-4158-94b2-52dde14beefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8b2801-8e5c-4158-94b2-52dde14beefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f4725d-5b3a-46a4-9e77-1a906465d7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:03 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Volume 56bb8d82-3bad-489a-9f31-dad07987ddd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bb8d82-3bad-489a-9f31-dad07987ddd9', 'volume_size': 1}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1791239976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bb8d82-3bad-489a-9f31-dad07987ddd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320e2191c88a46f797fe4f0137fbe589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:03Z,use_quota=True,user_id='039abeecf16b47408deded95a31791b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Creating volume 56bb8d82-3bad-489a-9f31-dad07987ddd9 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:43:03 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-56bb8d82-3bad-489a-9f31-dad07987ddd9 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:03 devstack quobyte-client[83143]: System call of process 93634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:03 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=62, name=volume-56bb8d82-3bad-489a-9f31-dad07987ddd9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-56bb8d82-3bad-489a-9f31-dad07987ddd9 1073741824" returned: 0 in 0.524s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-56bb8d82-3bad-489a-9f31-dad07987ddd9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-56bb8d82-3bad-489a-9f31-dad07987ddd9" returned: 0 in 0.263s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] <== create_volume: return (942ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "cinder-a35c391b-56a1-4924-bd39-154ace6b4cbe-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f4725d-5b3a-46a4-9e77-1a906465d7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bb8d82-3bad-489a-9f31-dad07987ddd9', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6291a3c7-664e-4783-a5c9-c3b0cc0b6882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:04 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Volume volume-56bb8d82-3bad-489a-9f31-dad07987ddd9 (56bb8d82-3bad-489a-9f31-dad07987ddd9): created successfully
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6291a3c7-664e-4783-a5c9-c3b0cc0b6882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Flow 'volume_create_manager' (af82b007-1416-416c-b57a-49dd263f1892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-a35c391b-56a1-4924-bd39-154ace6b4cbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.169s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "cinder-quobyte-1c8dd502-26b4-493c-9c22-a9a074cfcc55" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:04 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6c0eb31a-4356-4d7a-9f1c-ea09b6d0fe2b tempest-VolumesTransfersV357Test-1198703862 None] Created volume successfully.
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-quobyte-1c8dd502-26b4-493c-9c22-a9a074cfcc55" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "cinder-quobyte-a35c391b-56a1-4924-bd39-154ace6b4cbe" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-quobyte-a35c391b-56a1-4924-bd39-154ace6b4cbe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Deleting offline snapshot a35c391b-56a1-4924-bd39-154ace6b4cbe of volume 1c8dd502-26b4-493c-9c22-a9a074cfcc55 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] snapshot_file for this snap is: volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a27f85-c7c5-4118-96b5-2f4e0756e9fe]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:43:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe" returned: 0 in 0.573s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:43:05 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c6db83-25c2-479e-9241-6d5154e1124a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:43:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:05 devstack quobyte-client[83143]: System call of process 93643 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Acquiring lock "cinder-56bb8d82-3bad-489a-9f31-dad07987ddd9-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Lock "cinder-56bb8d82-3bad-489a-9f31-dad07987ddd9-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55" returned: 0 in 1.018s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:06 devstack quobyte-client[83143]: System call of process 93658 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:07 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Acquiring lock "cinder-quobyte-56bb8d82-3bad-489a-9f31-dad07987ddd9" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe" returned: 0 in 0.989s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Lock "cinder-quobyte-56bb8d82-3bad-489a-9f31-dad07987ddd9" acquired by "delete_volume" :: waited 0.383s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:07 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e015ae2c-146f-470a-842e-11be032cccf7]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:43:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-56bb8d82-3bad-489a-9f31-dad07987ddd9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55.a35c391b-56a1-4924-bd39-154ace6b4cbe" returned: 0 in 0.404s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-quobyte-a35c391b-56a1-4924-bd39-154ace6b4cbe" released by "_delete_snapshot" :: held 3.384s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-quobyte-1c8dd502-26b4-493c-9c22-a9a074cfcc55" released by "delete_snapshot" :: held 3.412s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:08 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Created reservations ['b6f93f8b-2895-4519-b837-0b064754cb33', '2b07e728-53f2-43d1-aeb5-6d8c4a042dca', '96bdac3d-4355-4d69-b2ff-c5ec4d09e615', 'f6d78457-bb3f-4a57-823c-979e41b20d7c'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:43:08 devstack quobyte-client[83143]: System call of process 93682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-56bb8d82-3bad-489a-9f31-dad07987ddd9" returned: 0 in 0.843s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-56bb8d82-3bad-489a-9f31-dad07987ddd9 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:08 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Delete snapshot completed successfully.
Sep 17 19:43:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "cinder-1c8dd502-26b4-493c-9c22-a9a074cfcc55-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-093392d1-bc51-4976-a49a-866d2666be8e tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-a35c391b-56a1-4924-bd39-154ace6b4cbe-delete_snapshot" released by "delete_snapshot" :: held 4.383s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-56bb8d82-3bad-489a-9f31-dad07987ddd9" returned: 0 in 0.414s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-1c8dd502-26b4-493c-9c22-a9a074cfcc55-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Lock "cinder-quobyte-56bb8d82-3bad-489a-9f31-dad07987ddd9" released by "delete_volume" :: held 1.544s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "cinder-quobyte-1c8dd502-26b4-493c-9c22-a9a074cfcc55" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-quobyte-1c8dd502-26b4-493c-9c22-a9a074cfcc55" acquired by "delete_volume" :: waited 0.030s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Created reservations ['8ddd4362-3449-46eb-a9b1-34e024389b7f', 'ea968c8f-3b15-491c-8a96-c1deb1a1f846', '956f038b-8020-4478-a787-f4e1a29d20ae', 'b0757195-ef73-4e35-8b12-dbbb94ac9965'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d30f4-83e7-47ac-98c9-64055f1b33a9]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.179s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:10 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:43:10 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Deleted volume successfully.
Sep 17 19:43:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55" returned: 0 in 1.180s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-1c8dd502-26b4-493c-9c22-a9a074cfcc55" returned: 0 in 0.299s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-quobyte-1c8dd502-26b4-493c-9c22-a9a074cfcc55" released by "delete_volume" :: held 1.638s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7286644c-b5ca-4d8a-932d-791192e7d12c tempest-VolumesTransfersV357Test-853384399 None] Lock "cinder-56bb8d82-3bad-489a-9f31-dad07987ddd9-delete_volume" released by "delete_volume" :: held 5.050s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Created reservations ['79ad64e0-7cc0-4e9c-a881-666a7049c17a', 'bd4fba0a-710b-4ee4-a225-c8bf8c3236d3', '5ba84993-23ab-4297-8228-33b5b5dfed5b', '8af0c159-8004-4afe-b699-10caa87c2d79'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.135s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:11 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:43:11 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Deleted volume successfully.
Sep 17 19:43:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e0229ea2-c417-4b7b-b1b6-659beda9bfc5 tempest-SnapshotMetadataTestJSON-818413420 None] Lock "cinder-1c8dd502-26b4-493c-9c22-a9a074cfcc55-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Flow 'volume_create_manager' (354fc933-0668-4a6e-9c8a-62816f6b11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a47d89-b741-431f-bd93-3ea6d0031805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a47d89-b741-431f-bd93-3ea6d0031805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1296342521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4dd0c89-d142-4081-9ad1-84f73168111f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e4ad06164c6435f9387ea5d16b14727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:17Z,use_quota=True,user_id='f7f9abe344af4d0793438428e474ce70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20cda93-82af-4c1d-bb47-833d2a9426d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20cda93-82af-4c1d-bb47-833d2a9426d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6451d02f-7ac3-48cf-a76b-bfb53eefa983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6451d02f-7ac3-48cf-a76b-bfb53eefa983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4dd0c89-d142-4081-9ad1-84f73168111f', 'volume_name': 'volume-c4dd0c89-d142-4081-9ad1-84f73168111f', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18938ea-6586-419e-85be-47d14ab419e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18938ea-6586-419e-85be-47d14ab419e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c41ef7-361c-49ab-abe0-635c4bd5fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Volume c4dd0c89-d142-4081-9ad1-84f73168111f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4dd0c89-d142-4081-9ad1-84f73168111f', 'volume_size': 1}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1296342521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4dd0c89-d142-4081-9ad1-84f73168111f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e4ad06164c6435f9387ea5d16b14727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:17Z,use_quota=True,user_id='f7f9abe344af4d0793438428e474ce70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Creating volume c4dd0c89-d142-4081-9ad1-84f73168111f {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:43:17 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:43:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c4dd0c89-d142-4081-9ad1-84f73168111f 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:17 devstack quobyte-client[83143]: System call of process 93699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:18 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=63, name=volume-c4dd0c89-d142-4081-9ad1-84f73168111f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c4dd0c89-d142-4081-9ad1-84f73168111f 1073741824" returned: 0 in 0.439s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c4dd0c89-d142-4081-9ad1-84f73168111f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c4dd0c89-d142-4081-9ad1-84f73168111f" returned: 0 in 0.199s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] <== create_volume: return (748ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c41ef7-361c-49ab-abe0-635c4bd5fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4dd0c89-d142-4081-9ad1-84f73168111f', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eba8674-be7b-4e43-b534-82e28556ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Volume volume-c4dd0c89-d142-4081-9ad1-84f73168111f (c4dd0c89-d142-4081-9ad1-84f73168111f): created successfully
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eba8674-be7b-4e43-b534-82e28556ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Flow 'volume_create_manager' (354fc933-0668-4a6e-9c8a-62816f6b11ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:18 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3693fae1-3149-40de-9521-1fa4caeec92e tempest-AbsoluteLimitsTests-1047918579 None] Created volume successfully.
Sep 17 19:43:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Acquiring lock "cinder-c4dd0c89-d142-4081-9ad1-84f73168111f-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Lock "cinder-c4dd0c89-d142-4081-9ad1-84f73168111f-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Acquiring lock "cinder-quobyte-c4dd0c89-d142-4081-9ad1-84f73168111f" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Lock "cinder-quobyte-c4dd0c89-d142-4081-9ad1-84f73168111f" acquired by "delete_volume" :: waited 0.021s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:20 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[45258d2a-b501-4d57-9aef-e59e46c4aed2]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:43:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c4dd0c89-d142-4081-9ad1-84f73168111f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c4dd0c89-d142-4081-9ad1-84f73168111f" returned: 0 in 0.627s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c4dd0c89-d142-4081-9ad1-84f73168111f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c4dd0c89-d142-4081-9ad1-84f73168111f" returned: 0 in 0.165s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Lock "cinder-quobyte-c4dd0c89-d142-4081-9ad1-84f73168111f" released by "delete_volume" :: held 1.070s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Created reservations ['cf4f5672-448f-47fe-ad45-bb120c1d50af', 'e173bce9-5dc6-4080-b83d-58d353a6fee6', 'f7924e38-c1cc-4253-bd2a-74651044f673', 'cc9ea2e9-5831-494a-8cc4-f1c1a6cb2cf4'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.152s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:22 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:43:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Deleted volume successfully.
Sep 17 19:43:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-37d3a1df-1515-4dbb-aa30-f84324a44867 tempest-AbsoluteLimitsTests-1047918579 None] Lock "cinder-c4dd0c89-d142-4081-9ad1-84f73168111f-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:30 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Flow 'volume_create_manager' (d13b27e1-b8d3-4810-9e3c-775a62816a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53debe69-75bb-4234-a101-ead49554ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53debe69-75bb-4234-a101-ead49554ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-553582825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2d2443-25e1-4781-b178-e14e240eeff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa3c1ef711a42bbbcf27136e900b3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:30Z,use_quota=True,user_id='b5cbf359859f4b79bcb3131aa2ccb0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5429cb9b-637b-4166-9c0c-ba151ee8239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5429cb9b-637b-4166-9c0c-ba151ee8239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f914365c-7deb-4b21-a0ff-9261b971815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f914365c-7deb-4b21-a0ff-9261b971815d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2d2443-25e1-4781-b178-e14e240eeff3', 'volume_name': 'volume-cb2d2443-25e1-4781-b178-e14e240eeff3', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91448eb-c65b-47bb-b447-991c0d536fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91448eb-c65b-47bb-b447-991c0d536fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d630322b-2822-44a8-a55e-535b24feb470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:30 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Volume cb2d2443-25e1-4781-b178-e14e240eeff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2d2443-25e1-4781-b178-e14e240eeff3', 'volume_size': 1}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-553582825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2d2443-25e1-4781-b178-e14e240eeff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa3c1ef711a42bbbcf27136e900b3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:30Z,use_quota=True,user_id='b5cbf359859f4b79bcb3131aa2ccb0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Creating volume cb2d2443-25e1-4781-b178-e14e240eeff3 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:43:30 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cb2d2443-25e1-4781-b178-e14e240eeff3 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:30 devstack quobyte-client[83143]: System call of process 93760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:30 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=64, name=volume-cb2d2443-25e1-4781-b178-e14e240eeff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cb2d2443-25e1-4781-b178-e14e240eeff3 1073741824" returned: 0 in 0.356s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cb2d2443-25e1-4781-b178-e14e240eeff3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cb2d2443-25e1-4781-b178-e14e240eeff3" returned: 0 in 0.123s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:43:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d630322b-2822-44a8-a55e-535b24feb470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2d2443-25e1-4781-b178-e14e240eeff3', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103c6d3c-09ec-423e-b66d-7a578b923579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:31 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Volume volume-cb2d2443-25e1-4781-b178-e14e240eeff3 (cb2d2443-25e1-4781-b178-e14e240eeff3): created successfully
Sep 17 19:43:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103c6d3c-09ec-423e-b66d-7a578b923579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Flow 'volume_create_manager' (d13b27e1-b8d3-4810-9e3c-775a62816a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:31 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a30303b1-18eb-43c6-975d-fe9a7704a736 tempest-VolumesTransfersTest-849907406 None] Created volume successfully.
Sep 17 19:43:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c29d81b9-d26d-4c21-b900-640680ea9104 tempest-VolumesTransfersTest-2086720415 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:33 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c29d81b9-d26d-4c21-b900-640680ea9104 tempest-VolumesTransfersTest-2086720415 None] Transfer volume completed successfully.
Sep 17 19:43:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Flow 'volume_create_manager' (22f83663-8f47-437b-9061-243a080910b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c057b57b-1dbb-4793-98dd-42f451c81d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c057b57b-1dbb-4793-98dd-42f451c81d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1886542725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba022f77-73e4-4b7a-98e5-06f714fc0191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2a54fed645416e8ae623e953e4d09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:34Z,use_quota=True,user_id='de18d9d5e507499788a6dc15f8e65970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6be2d8-ff9e-4262-8dd8-ed8520820e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6be2d8-ff9e-4262-8dd8-ed8520820e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38955982-dff2-4dae-ab2b-832a3c25a99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38955982-dff2-4dae-ab2b-832a3c25a99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba022f77-73e4-4b7a-98e5-06f714fc0191', 'volume_name': 'volume-ba022f77-73e4-4b7a-98e5-06f714fc0191', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3014d46d-d1b9-4977-bee8-2d9a3332fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3014d46d-d1b9-4977-bee8-2d9a3332fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0200958d-1753-4981-959f-53218a4a5bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:33 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Volume ba022f77-73e4-4b7a-98e5-06f714fc0191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba022f77-73e4-4b7a-98e5-06f714fc0191', 'volume_size': 1}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1886542725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba022f77-73e4-4b7a-98e5-06f714fc0191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2a54fed645416e8ae623e953e4d09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:34Z,use_quota=True,user_id='de18d9d5e507499788a6dc15f8e65970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Creating volume ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:43:33 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:43:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:34 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=65, name=volume-ba022f77-73e4-4b7a-98e5-06f714fc0191, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Acquiring lock "cinder-cb2d2443-25e1-4781-b178-e14e240eeff3-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Lock "cinder-cb2d2443-25e1-4781-b178-e14e240eeff3-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 1073741824" returned: 0 in 0.496s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:34 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Acquiring lock "cinder-quobyte-cb2d2443-25e1-4781-b178-e14e240eeff3" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 0.430s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] <== create_volume: return (954ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Lock "cinder-quobyte-cb2d2443-25e1-4781-b178-e14e240eeff3" acquired by "delete_volume" :: waited 0.096s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0200958d-1753-4981-959f-53218a4a5bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba022f77-73e4-4b7a-98e5-06f714fc0191', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c51fff-2bfc-477b-a0ad-f4e9e7cb4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a171d519-da6f-4a0b-b77c-e15ae01fcbbd]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cb2d2443-25e1-4781-b178-e14e240eeff3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:35 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Volume volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 (ba022f77-73e4-4b7a-98e5-06f714fc0191): created successfully
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c51fff-2bfc-477b-a0ad-f4e9e7cb4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Flow 'volume_create_manager' (22f83663-8f47-437b-9061-243a080910b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-93e2e628-6c1f-4448-8881-b079b240a895 tempest-VolumesActionsTest-1886565448 None] Created volume successfully.
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cb2d2443-25e1-4781-b178-e14e240eeff3" returned: 0 in 0.606s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cb2d2443-25e1-4781-b178-e14e240eeff3 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cb2d2443-25e1-4781-b178-e14e240eeff3" returned: 0 in 0.112s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Lock "cinder-quobyte-cb2d2443-25e1-4781-b178-e14e240eeff3" released by "delete_volume" :: held 0.889s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Created reservations ['15b85dd6-8dda-4a76-8e67-32c4f6510f07', '5685f210-06e7-40f0-9629-a3f8ae3d3dc6', '435cc60c-7ada-4860-abfc-7a59d680ec86', 'f03ea870-10fc-4e6b-9cd6-436f6bd92a4f'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.238s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:36 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:43:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Deleted volume successfully.
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0b9d4dfc-1e16-42ef-888f-1b4995bacdca tempest-VolumesTransfersTest-883849550 None] Lock "cinder-cb2d2443-25e1-4781-b178-e14e240eeff3-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:37 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Flow 'volume_create_manager' (90c9a990-4d6d-43bf-ba2f-f5d4171fbdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12be072-7c44-4811-bde8-7869d6026ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12be072-7c44-4811-bde8-7869d6026ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-463300875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa3c1ef711a42bbbcf27136e900b3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:37Z,use_quota=True,user_id='b5cbf359859f4b79bcb3131aa2ccb0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1e5e6e-5615-460d-9b14-69698cb31e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1e5e6e-5615-460d-9b14-69698cb31e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1624008-c731-4899-a684-6a21111f420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1624008-c731-4899-a684-6a21111f420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a', 'volume_name': 'volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea33a4db-fbdc-4a6d-81d3-1f10d1de005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea33a4db-fbdc-4a6d-81d3-1f10d1de005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c18f9d6-b006-4253-8232-269a9693254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:37 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Volume b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a', 'volume_size': 1}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-463300875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa3c1ef711a42bbbcf27136e900b3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:37Z,use_quota=True,user_id='b5cbf359859f4b79bcb3131aa2ccb0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Creating volume b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:43:37 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:43:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:38 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=66, name=volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:43:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a 1073741824" returned: 0 in 0.435s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a" returned: 0 in 0.186s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:38 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] <== create_volume: return (806ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:43:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c18f9d6-b006-4253-8232-269a9693254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7699c1e8-0c3a-4633-b1bd-8ba2fef3b2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:39 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Volume volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a (b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a): created successfully
Sep 17 19:43:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7699c1e8-0c3a-4633-b1bd-8ba2fef3b2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:39 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Flow 'volume_create_manager' (90c9a990-4d6d-43bf-ba2f-f5d4171fbdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:39 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2c635a17-424d-4271-a26a-0dd73fd9d8a9 tempest-VolumesTransfersTest-849907406 None] Created volume successfully.
Sep 17 19:43:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Acquiring lock "cinder-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Lock "cinder-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:40 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Acquiring lock "cinder-quobyte-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:43:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Lock "cinder-quobyte-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a" acquired by "delete_volume" :: waited 0.024s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:43:40 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed6a94d-c1e6-4be2-b4b2-ba951daad0c0]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:43:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a" returned: 0 in 0.469s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a" returned: 0 in 0.122s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Lock "cinder-quobyte-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a" released by "delete_volume" :: held 0.771s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Created reservations ['90af6d81-9969-498b-b832-458f0254031d', 'c4c7267b-3c45-4a36-bc2b-efb4da8eaba7', '84b5ab1e-3389-42bb-8b96-fb838adf0821', 'eae8b1a0-8ee2-4549-b3b5-00f7ed012f80'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=56,cinder:SELECT=41,cinder:INSERT=13,cinder:DELETE=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.090s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:42 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:43:42 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Deleted volume successfully.
Sep 17 19:43:42 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=48,cinder:DELETE=10,cinder:UPDATE=82,cinder:INSERT=15 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:43:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1654f978-4681-4b23-b6a1-540f1cbe4c9d tempest-VolumesTransfersTest-883849550 None] Lock "cinder-b31e15dd-7e6f-42fc-9d8c-f0cd7e4dad9a-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:43:52 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Flow 'volume_create_manager' (a5f9fa64-e50c-4a1a-98b5-5b31a08c40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbcd854-c140-4e4f-90ba-7e9559b19209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbcd854-c140-4e4f-90ba-7e9559b19209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1287444083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c8956cfef746c094eb2f50be5604a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:52Z,use_quota=True,user_id='ce95ceee2dc9420aa25827b4fed6adbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a278414-3cf7-421c-966f-a6804537e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a278414-3cf7-421c-966f-a6804537e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc346e-a8ae-4466-b2ee-59e39efb2fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc346e-a8ae-4466-b2ee-59e39efb2fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e', 'volume_name': 'volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68197d8c-84d4-45cb-a2e2-3cc592403cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68197d8c-84d4-45cb-a2e2-3cc592403cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf658cd-3b0e-458e-b8e3-b8c3314f85f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:52 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Volume 7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e', 'volume_size': 1}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1287444083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c8956cfef746c094eb2f50be5604a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:43:52Z,use_quota=True,user_id='ce95ceee2dc9420aa25827b4fed6adbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Creating volume 7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:43:52 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:43:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:53 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=67, name=volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:43:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e 1073741824" returned: 0 in 0.747s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" returned: 0 in 0.140s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] <== create_volume: return (1092ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:43:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf658cd-3b0e-458e-b8e3-b8c3314f85f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb88d559-bfd8-4da4-850e-f2cb8b0e08fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:43:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 1.285s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:43:55 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Volume volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e (7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e): created successfully
Sep 17 19:43:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb88d559-bfd8-4da4-850e-f2cb8b0e08fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:43:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Flow 'volume_create_manager' (a5f9fa64-e50c-4a1a-98b5-5b31a08c40f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:43:56 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c8e14000-6051-40ce-a939-23a9bf8886e7 tempest-VolumesSnapshotListTestJSON-81997811 None] Created volume successfully.
Sep 17 19:43:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:43:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:43:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:43:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Creating offline snapshot 4336c7fd-445b-42fb-ae96-0d27df2c4a2f of volume 7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:43:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6042d3f-95f3-4ee2-a458-95bb777f797b]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:43:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:58 devstack quobyte-client[83143]: System call of process 93843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" returned: 0 in 1.197s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:43:59 devstack quobyte-client[83143]: System call of process 93871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:59 devstack quobyte-client[83143]: System call of process 93871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:59 devstack quobyte-client[83143]: System call of process 93871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:43:59 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=68, name=volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:43:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f 1G" returned: 0 in 0.834s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:43:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:00 devstack quobyte-client[83143]: System call of process 93891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:44:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img rebase -u -b volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f" returned: 0 in 0.607s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:44:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f" returned: 0 in 0.199s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:44:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f" returned: 0 in 0.202s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.info" returned: 0 in 0.199s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:44:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.info" returned: 0 in 0.169s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.295s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:44:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-ebca99f8-473c-487a-896f-6938e1606c81 tempest-VolumesSnapshotListTestJSON-81997811 None] Create snapshot completed successfully
Sep 17 19:44:03 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:44:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:44:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Creating offline snapshot 42213936-7ad1-4d0f-a47b-e0848ff225fb of volume 7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:44:04 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede6a6bc-e8ad-46c0-b0d4-d8ea4448f179]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f" returned: 0 in 1.857s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:44:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:06 devstack quobyte-client[83143]: System call of process 93967 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:44:06 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=70, name=volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:44:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb 1G" returned: 0 in 0.548s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:07 devstack quobyte-client[83143]: System call of process 93972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:44:07 devstack quobyte-client[83143]: System call of process 93972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:44:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img rebase -u -b volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb" returned: 0 in 0.409s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:44:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb" returned: 0 in 0.221s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:44:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb" returned: 0 in 0.326s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.387s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:44:09 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b71a7cb1-fd67-4604-8158-774682d4f8df tempest-VolumesSnapshotListTestJSON-81997811 None] Create snapshot completed successfully
Sep 17 19:44:11 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:44:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:44:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Creating offline snapshot 3020dd79-2a45-4b7e-b730-9fa58f81ea5d of volume 7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:44:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[289477c9-619e-426b-99a0-99f0c8b252c7]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb" returned: 0 in 1.328s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:44:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:13 devstack quobyte-client[83143]: System call of process 94042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:44:13 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=71, name=volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:44:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d 1G" returned: 0 in 0.742s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:14 devstack quobyte-client[83143]: System call of process 94051 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img rebase -u -b volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d" returned: 0 in 0.419s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d" returned: 0 in 0.132s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d" returned: 0 in 0.105s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.435s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:44:14 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60ce2e14-deee-45ea-a982-612efec811e6 tempest-VolumesActionsTest-1886565448 None] Acquiring lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191" by "attach_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4614565e-7efb-4e87-a0a5-fc33b6487bfc tempest-VolumesSnapshotListTestJSON-81997811 None] Create snapshot completed successfully
Sep 17 19:44:15 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60ce2e14-deee-45ea-a982-612efec811e6 tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191" acquired by "attach_volume" :: waited 0.078s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:15 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-60ce2e14-deee-45ea-a982-612efec811e6 tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-60ce2e14-deee-45ea-a982-612efec811e6 tempest-VolumesActionsTest-1886565448 None] Attaching volume ba022f77-73e4-4b7a-98e5-06f714fc0191 to instance 99898dc9-7eba-41b5-bdab-193054b9a472 at mountpoint /dev/vdb on host None.
Sep 17 19:44:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-60ce2e14-deee-45ea-a982-612efec811e6 tempest-VolumesActionsTest-1886565448 None] Attach volume completed successfully.
Sep 17 19:44:15 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-60ce2e14-deee-45ea-a982-612efec811e6 tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191" released by "attach_volume" :: held 0.322s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:16 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-92b68580-85a9-422c-b20e-2c09e99c0aaf tempest-VolumesActionsTest-1886565448 None] Acquiring lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-detach_volume" by "detach_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:16 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-92b68580-85a9-422c-b20e-2c09e99c0aaf tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-92b68580-85a9-422c-b20e-2c09e99c0aaf tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-92b68580-85a9-422c-b20e-2c09e99c0aaf tempest-VolumesActionsTest-1886565448 None] Detaching volume ba022f77-73e4-4b7a-98e5-06f714fc0191 from instance 99898dc9-7eba-41b5-bdab-193054b9a472.
Sep 17 19:44:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-92b68580-85a9-422c-b20e-2c09e99c0aaf tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-92b68580-85a9-422c-b20e-2c09e99c0aaf tempest-VolumesActionsTest-1886565448 None] Detach volume completed successfully.
Sep 17 19:44:16 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-92b68580-85a9-422c-b20e-2c09e99c0aaf tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-detach_volume" released by "detach_volume" :: held 0.232s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-3020dd79-2a45-4b7e-b730-9fa58f81ea5d-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-3020dd79-2a45-4b7e-b730-9fa58f81ea5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-quobyte-3020dd79-2a45-4b7e-b730-9fa58f81ea5d" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-3020dd79-2a45-4b7e-b730-9fa58f81ea5d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Deleting offline snapshot 3020dd79-2a45-4b7e-b730-9fa58f81ea5d of volume 7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] snapshot_file for this snap is: volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4800fab-a950-4f9b-9557-3306ee3d379a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d" returned: 0 in 0.535s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:44:18 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c094b-e0a4-4f4f-b850-0fe5ba443551]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:18 devstack quobyte-client[83143]: System call of process 94063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:44:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb" returned: 0 in 0.850s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:44:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:19 devstack quobyte-client[83143]: System call of process 94099 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:44:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d" returned: 0 in 0.540s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.3020dd79-2a45-4b7e-b730-9fa58f81ea5d" returned: 0 in 0.219s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-3020dd79-2a45-4b7e-b730-9fa58f81ea5d" released by "_delete_snapshot" :: held 2.779s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" released by "delete_snapshot" :: held 2.823s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:20 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Created reservations ['b2cfd178-29a1-465a-bfb3-d952cdce4a15', 'd714cc22-04c1-4aae-907b-f4d6dba25925', 'dba96201-3042-440b-b90b-0c84714ad248', 'db992f03-2e43-473d-9819-6143a83a0fc2'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:44:20 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Delete snapshot completed successfully.
Sep 17 19:44:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-5648877e-8f03-4cca-8256-3de21c7f06e4 tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-3020dd79-2a45-4b7e-b730-9fa58f81ea5d-delete_snapshot" released by "delete_snapshot" :: held 3.318s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-42213936-7ad1-4d0f-a47b-e0848ff225fb-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-42213936-7ad1-4d0f-a47b-e0848ff225fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:21 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-quobyte-42213936-7ad1-4d0f-a47b-e0848ff225fb" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-42213936-7ad1-4d0f-a47b-e0848ff225fb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Deleting offline snapshot 42213936-7ad1-4d0f-a47b-e0848ff225fb of volume 7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] snapshot_file for this snap is: volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7ed558-7828-42a2-9645-c26a5cbc79b7]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb" returned: 0 in 0.445s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:44:22 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca4be22-c681-4e54-9325-74379ec03fe9]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f" returned: 0 in 0.368s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:44:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb" returned: 0 in 0.270s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.42213936-7ad1-4d0f-a47b-e0848ff225fb" returned: 0 in 0.106s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-42213936-7ad1-4d0f-a47b-e0848ff225fb" released by "_delete_snapshot" :: held 1.535s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" released by "delete_snapshot" :: held 1.568s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Created reservations ['0ee91eb8-533c-4eb5-8cf4-2d0cc56ee8ae', '3dcf485a-6f41-4c4c-bdd2-f9236019cae0', 'aa73bd85-e2a8-4914-8d01-af4d4771db4b', '45e335a7-ff97-4a62-ba35-8a753cacef98'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:44:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Delete snapshot completed successfully.
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-95b51c8b-3cf0-4b80-9e26-04a95b76bbea tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-42213936-7ad1-4d0f-a47b-e0848ff225fb-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-4336c7fd-445b-42fb-ae96-0d27df2c4a2f-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-4336c7fd-445b-42fb-ae96-0d27df2c4a2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-quobyte-4336c7fd-445b-42fb-ae96-0d27df2c4a2f" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-4336c7fd-445b-42fb-ae96-0d27df2c4a2f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Deleting offline snapshot 4336c7fd-445b-42fb-ae96-0d27df2c4a2f of volume 7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:44:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] snapshot_file for this snap is: volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:44:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8b1453-bd25-4508-8477-ca104ebc6384]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f" returned: 0 in 0.456s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:44:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a8c57d-d43f-4d86-9364-4995a5f6a29e]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" returned: 0 in 0.438s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f" returned: 0 in 0.215s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e.4336c7fd-445b-42fb-ae96-0d27df2c4a2f" returned: 0 in 0.091s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-4336c7fd-445b-42fb-ae96-0d27df2c4a2f" released by "_delete_snapshot" :: held 1.525s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" released by "delete_snapshot" :: held 1.558s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:25 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Created reservations ['df9cbd73-917d-44fa-9e7c-569f66bc89ee', '6bc0b10e-6959-4175-81aa-c20aad70d36d', '122570f6-58a8-443e-af4d-f9f0d86a58bf', 'ac3cf5fa-6379-43db-bc07-8f68380a9d38'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:44:26 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Delete snapshot completed successfully.
Sep 17 19:44:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d6b25dc-a337-4a90-b989-02bfcd08ec5a tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-4336c7fd-445b-42fb-ae96-0d27df2c4a2f-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:26 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:44:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:44:26 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed1bd4f-9dce-4b93-8f4a-2b3efd7a7ec5]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:44:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" returned: 0 in 0.531s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" returned: 0 in 0.099s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-quobyte-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e" released by "delete_volume" :: held 0.838s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Created reservations ['4163d61b-397b-4570-8402-d85dbf5b1c86', '6741676f-a204-435e-9429-dc4dbd7ea090', '8f6ee47d-3161-4602-9e66-136b2150f4d8', 'cefa25d8-47d1-4238-9f17-9424dc703e50'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.122s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:27 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:44:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Deleted volume successfully.
Sep 17 19:44:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-42f09a13-8ec0-4b0f-85f1-b51a21d9f81b tempest-VolumesSnapshotListTestJSON-81997811 None] Lock "cinder-7df24b6b-6a8a-4ebc-b1a1-cf9c9a1b916e-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:44:37 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-9bb0edae-629a-496e-be13-e778277ea84c req-d9b808d0-29af-49b5-ba26-d39645c10036 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:37 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-9bb0edae-629a-496e-be13-e778277ea84c req-d9b808d0-29af-49b5-ba26-d39645c10036 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:44:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-9bb0edae-629a-496e-be13-e778277ea84c req-d9b808d0-29af-49b5-ba26-d39645c10036 tempest-AttachVolumeNegativeTest-1241069812 None] Terminate volume connection completed successfully.
Sep 17 19:44:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-9bb0edae-629a-496e-be13-e778277ea84c req-d9b808d0-29af-49b5-ba26-d39645c10036 tempest-AttachVolumeNegativeTest-1241069812 None] Deleting attachment 47f7f7d2-7aab-44fa-a0a4-a6bfc6e0976c. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:44:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=26,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:44:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=39,cinder:UPDATE=39,cinder:DELETE=4,cinder:INSERT=10 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:44:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:44:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:44:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:44:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:44:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:44:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:44:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:44:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.414s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:44:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:45:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d125db4-deef-4b6e-a79a-047e5c19217c tempest-VolumesActionsTest-1886565448 None] Acquiring lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191" by "attach_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:45:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d125db4-deef-4b6e-a79a-047e5c19217c tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191" acquired by "attach_volume" :: waited 0.043s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:45:01 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6d125db4-deef-4b6e-a79a-047e5c19217c tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:45:01 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6d125db4-deef-4b6e-a79a-047e5c19217c tempest-VolumesActionsTest-1886565448 None] Attaching volume ba022f77-73e4-4b7a-98e5-06f714fc0191 to instance 3f395568-bf5d-4946-9b95-e1e9a2b863ba at mountpoint /dev/vdb on host None.
Sep 17 19:45:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6d125db4-deef-4b6e-a79a-047e5c19217c tempest-VolumesActionsTest-1886565448 None] Attach volume completed successfully.
Sep 17 19:45:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6d125db4-deef-4b6e-a79a-047e5c19217c tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191" released by "attach_volume" :: held 0.950s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:45:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e2f4fd9d-b41a-4548-80fd-35514719c66b tempest-VolumesActionsTest-1886565448 None] Acquiring lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-detach_volume" by "detach_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:45:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e2f4fd9d-b41a-4548-80fd-35514719c66b tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:45:03 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e2f4fd9d-b41a-4548-80fd-35514719c66b tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:45:03 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e2f4fd9d-b41a-4548-80fd-35514719c66b tempest-VolumesActionsTest-1886565448 None] Detaching volume ba022f77-73e4-4b7a-98e5-06f714fc0191 from instance 3f395568-bf5d-4946-9b95-e1e9a2b863ba.
Sep 17 19:45:03 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e2f4fd9d-b41a-4548-80fd-35514719c66b tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:45:03 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e2f4fd9d-b41a-4548-80fd-35514719c66b tempest-VolumesActionsTest-1886565448 None] Detach volume completed successfully.
Sep 17 19:45:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e2f4fd9d-b41a-4548-80fd-35514719c66b tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-detach_volume" released by "detach_volume" :: held 0.260s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:45:13 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:45:13 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:45:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:45:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:45:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:45:16 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6405d47b-7c25-4952-8c57-e724890d7f15]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:45:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:45:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 0.566s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:45:17 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620851e-4b12-4b1f-8a3a-e3f1e388bf23]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:45:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:45:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 0.928s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:45:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.7b9a5614-6b3d-43ad-803a-36d7b66fff5ev0pu1k94.img {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:45:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.7b9a5614-6b3d-43ad-803a-36d7b66fff5ev0pu1k94.img" returned: 0 in 7.573s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:45:26 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc2bf6-854f-45c6-aaa1-93e6032ca1ca]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:45:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:45:26 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:45:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 1.285s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:45:27 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.7b9a5614-6b3d-43ad-803a-36d7b66fff5ev0pu1k94.img {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:45:27 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Converted 1024.00 MB image at 134.50 MB/s
Sep 17 19:45:27 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] 7b9a5614-6b3d-43ad-803a-36d7b66fff5e was raw, no need to convert to raw {{(pid=83122) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 17 19:45:46 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:45:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:45:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:45:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:45:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:45:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:45:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:45:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.102s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:45:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:45:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 1.752s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:45:57 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:46:14 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Flow 'volume_create_manager' (7d43e4dd-62f1-48ed-9f52-055bd656d0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63a286f-4190-4fa9-8eb5-70972583458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63a286f-4190-4fa9-8eb5-70972583458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-755962397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4b54808aed433d93578b2712bfd42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:46:14Z,use_quota=True,user_id='c4a2a4483c074b4ea4fd88a38930ad64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d577e9-398d-4d28-98ee-875c517fbe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d577e9-398d-4d28-98ee-875c517fbe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590059b3-c6e4-4c16-9f9e-9a35e9a33b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590059b3-c6e4-4c16-9f9e-9a35e9a33b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4', 'volume_name': 'volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7668860-4a9f-4fe3-b9f8-39e8941dbe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7668860-4a9f-4fe3-b9f8-39e8941dbe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd322e88-ebe9-4440-8db1-e46335c3ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:46:14 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Volume f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4', 'volume_size': 1}
Sep 17 19:46:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:46:24 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:46:24 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 96.509s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Uploaded volume to glance image-id: 7b9a5614-6b3d-43ad-803a-36d7b66fff5e. {{(pid=83122) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 38.672s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-755962397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4b54808aed433d93578b2712bfd42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:46:14Z,use_quota=True,user_id='c4a2a4483c074b4ea4fd88a38930ad64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Creating volume f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:46:53 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:46:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:46:53 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-740f2d89-7a0e-4ed1-aedb-5c880f4dfeab tempest-VolumesActionsTest-1886565448 None] Copy volume to image completed successfully.
Sep 17 19:46:53 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=72, name=volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:46:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:46:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:46:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:46:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:46:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:46:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:46:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:46:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4 1073741824" returned: 0 in 1.719s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:46:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:46:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.736s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:46:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:46:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4" returned: 0 in 0.485s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:46:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] <== create_volume: return (2369ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:46:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:46:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd322e88-ebe9-4440-8db1-e46335c3ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:46:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebf2b81-e4d8-4783-bd26-0d194a2d6a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:46:56 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Volume volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4 (f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4): created successfully
Sep 17 19:46:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebf2b81-e4d8-4783-bd26-0d194a2d6a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:46:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Flow 'volume_create_manager' (7d43e4dd-62f1-48ed-9f52-055bd656d0cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:46:56 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:46:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:46:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:46:56 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2debdfb1-9c75-4848-89b1-209428465acd tempest-TestMinimumBasicScenario-2022978301 None] Created volume successfully.
Sep 17 19:46:56 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2768b4d9-97dc-4129-9c0d-69d7ad833e41]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:46:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:46:57 devstack quobyte-client[83143]: System call of process 94784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:46:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 1.094s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:46:58 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7310ac89-6653-41d9-b8b4-47a7144d31ac]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:46:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:46:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 0.834s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:46:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:46:59 devstack quobyte-client[83143]: System call of process 94796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:47:06 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:47:07 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:47:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img" returned: 0 in 9.591s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:08 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5938df45-c578-4730-a67d-0310b5e8939b]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:09 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:47:09 devstack quobyte-client[83143]: System call of process 94842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:47:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Flow 'volume_create_manager' (96e9f62f-4ff9-409f-91d0-41be0da7966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:47:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a56db9d-7151-464d-8d03-0d70ee845016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a56db9d-7151-464d-8d03-0d70ee845016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1898989216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67839bf0-2df2-4525-bc73-8896fc116207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc774e5279cd49ae9ba0f4b247631856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:47:09Z,use_quota=True,user_id='d846be0f4d7d430aad9f4ead0735779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78f74ab-9aac-421f-bd3e-cc2329a6070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78f74ab-9aac-421f-bd3e-cc2329a6070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c016fb-97d0-40f1-896a-17419e0bdccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c016fb-97d0-40f1-896a-17419e0bdccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67839bf0-2df2-4525-bc73-8896fc116207', 'volume_name': 'volume-67839bf0-2df2-4525-bc73-8896fc116207', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e2cd59-5817-4df3-88a6-9f1b0e9fcb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e2cd59-5817-4df3-88a6-9f1b0e9fcb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199d8a41-f6df-41c9-80c2-3bbc1816f3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:10 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Volume 67839bf0-2df2-4525-bc73-8896fc116207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67839bf0-2df2-4525-bc73-8896fc116207', 'volume_size': 1}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-62777e83-bb03-44d1-991c-812aa8bc9212 req-a90e0a3f-acbc-4c2f-afa4-69293e35176b tempest-TestMinimumBasicScenario-2022978301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 1.699s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191, size 1024.00 MB, duration 9.62 sec, destination /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:47:10 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Converted 1024.00 MB image at 106.41 MB/s
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] 2045bad6-64c7-4a83-b4a3-6884c606cee8 was raw, converting to qcow2 {{(pid=83122) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72a7503-6a55-4e8a-a361-551177145574]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img" returned: 0 in 0.560s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img" returned: 1 in 0.566s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img /opt/stack/data/cinder/conversion/vol_upload_368gguvs {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img /opt/stack/data/cinder/conversion/vol_upload_368gguvs" returned: 0 in 0.182s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Image conversion details: src /opt/stack/data/cinder/conversion/ba022f77-73e4-4b7a-98e5-06f714fc0191.temp_image.2045bad6-64c7-4a83-b4a3-6884c606cee8ckmojbxn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_368gguvs {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:47:11 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1dc901-76e6-4404-940d-fe80039b1a91]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_368gguvs {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_368gguvs" returned: 0 in 0.396s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.294s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Uploaded volume to glance image-id: 2045bad6-64c7-4a83-b4a3-6884c606cee8. {{(pid=83122) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.867s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1898989216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67839bf0-2df2-4525-bc73-8896fc116207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc774e5279cd49ae9ba0f4b247631856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:47:09Z,use_quota=True,user_id='d846be0f4d7d430aad9f4ead0735779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Creating volume 67839bf0-2df2-4525-bc73-8896fc116207 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:47:14 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:14 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=73, name=volume-67839bf0-2df2-4525-bc73-8896fc116207, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:47:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207 1073741824" returned: 0 in 0.869s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b3e7dd55-50c7-43d2-a0b0-6ac10747a40f tempest-VolumesActionsTest-1886565448 None] Copy volume to image completed successfully.
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207" returned: 0 in 0.300s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] <== create_volume: return (1252ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-62777e83-bb03-44d1-991c-812aa8bc9212 req-a90e0a3f-acbc-4c2f-afa4-69293e35176b tempest-TestMinimumBasicScenario-2022978301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.201s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbae5d8c-0f3a-418c-85d0-63cb4538b670]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-62777e83-bb03-44d1-991c-812aa8bc9212 req-a90e0a3f-acbc-4c2f-afa4-69293e35176b tempest-TestMinimumBasicScenario-2022978301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199d8a41-f6df-41c9-80c2-3bbc1816f3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67839bf0-2df2-4525-bc73-8896fc116207', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc11418-afa2-463a-b6b6-c11ac554c989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Volume volume-67839bf0-2df2-4525-bc73-8896fc116207 (67839bf0-2df2-4525-bc73-8896fc116207): created successfully
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc11418-afa2-463a-b6b6-c11ac554c989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Flow 'volume_create_manager' (96e9f62f-4ff9-409f-91d0-41be0da7966b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:47:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4ed2d468-5e94-4842-9cb4-9c0863adbc7b tempest-AttachVolumeNegativeTest-1241069812 None] Created volume successfully.
Sep 17 19:47:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-62777e83-bb03-44d1-991c-812aa8bc9212 req-a90e0a3f-acbc-4c2f-afa4-69293e35176b tempest-TestMinimumBasicScenario-2022978301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4" returned: 0 in 0.805s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-62777e83-bb03-44d1-991c-812aa8bc9212 req-a90e0a3f-acbc-4c2f-afa4-69293e35176b tempest-TestMinimumBasicScenario-2022978301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.908s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-62777e83-bb03-44d1-991c-812aa8bc9212 req-a90e0a3f-acbc-4c2f-afa4-69293e35176b tempest-TestMinimumBasicScenario-2022978301 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8962c52e-29c2-463b-bbff-cf3ef0bbfe70', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:47:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-62777e83-bb03-44d1-991c-812aa8bc9212 req-a90e0a3f-acbc-4c2f-afa4-69293e35176b tempest-TestMinimumBasicScenario-2022978301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-62777e83-bb03-44d1-991c-812aa8bc9212 req-a90e0a3f-acbc-4c2f-afa4-69293e35176b tempest-TestMinimumBasicScenario-2022978301 None] attachment_update completed successfully.
Sep 17 19:47:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Acquiring lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:47:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:47:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Acquiring lock "cinder-quobyte-ba022f77-73e4-4b7a-98e5-06f714fc0191" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:47:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Lock "cinder-quobyte-ba022f77-73e4-4b7a-98e5-06f714fc0191" acquired by "delete_volume" :: waited 0.052s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:47:17 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf317ba-939e-495f-b796-c6a752b439cf]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 0.808s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-ba022f77-73e4-4b7a-98e5-06f714fc0191" returned: 0 in 0.182s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:18 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Lock "cinder-quobyte-ba022f77-73e4-4b7a-98e5-06f714fc0191" released by "delete_volume" :: held 1.316s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:47:18 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Created reservations ['7822147e-023c-4c54-b3b5-e2a03448439f', 'df1684ed-ac62-4efb-97ec-81b09e682e37', '8bff46f5-d265-4ae2-b4e0-3fe5864a6735', '6073eaae-8b13-4075-b7ef-39b7d6b7b213'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:47:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:47:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:47:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.222s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:19 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:47:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Deleted volume successfully.
Sep 17 19:47:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a967150-f206-454b-b867-36e86a1e8e40 tempest-VolumesActionsTest-1886565448 None] Lock "cinder-ba022f77-73e4-4b7a-98e5-06f714fc0191-delete_volume" released by "delete_volume" :: held 3.515s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:47:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-89735336-611e-4b9d-bb7c-dc4bd1fe9f2a req-f8408282-7fab-4436-b092-705000eef747 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-89735336-611e-4b9d-bb7c-dc4bd1fe9f2a req-f8408282-7fab-4436-b092-705000eef747 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:21 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c378d2-9de3-434f-9cb8-08dfe8977a3d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-89735336-611e-4b9d-bb7c-dc4bd1fe9f2a req-f8408282-7fab-4436-b092-705000eef747 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-89735336-611e-4b9d-bb7c-dc4bd1fe9f2a req-f8408282-7fab-4436-b092-705000eef747 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207" returned: 0 in 0.846s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-89735336-611e-4b9d-bb7c-dc4bd1fe9f2a req-f8408282-7fab-4436-b092-705000eef747 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-89735336-611e-4b9d-bb7c-dc4bd1fe9f2a req-f8408282-7fab-4436-b092-705000eef747 tempest-AttachVolumeNegativeTest-1241069812 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-67839bf0-2df2-4525-bc73-8896fc116207', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0af87ae4-255f-4243-8fef-6c1ec6f26069', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:47:22 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-89735336-611e-4b9d-bb7c-dc4bd1fe9f2a req-f8408282-7fab-4436-b092-705000eef747 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-89735336-611e-4b9d-bb7c-dc4bd1fe9f2a req-f8408282-7fab-4436-b092-705000eef747 tempest-AttachVolumeNegativeTest-1241069812 None] attachment_update completed successfully.
Sep 17 19:47:32 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Flow 'volume_create_manager' (9bbe8321-0c9b-41d8-9884-7242fae1164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56868e9b-6bc2-480c-bc93-bdd7cfee58a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56868e9b-6bc2-480c-bc93-bdd7cfee58a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1793959223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610c7312-d484-49e9-9841-c77000118474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1717dec4e9ba42fdb478efb75e26c701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:47:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:47:32Z,use_quota=True,user_id='e74ebe27d4f04b91a520912947a7f84a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dce569-bc40-4eca-a0c9-418bd93158da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dce569-bc40-4eca-a0c9-418bd93158da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5836d8-2d48-457d-b264-1722d2726581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5836d8-2d48-457d-b264-1722d2726581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610c7312-d484-49e9-9841-c77000118474', 'volume_name': 'volume-610c7312-d484-49e9-9841-c77000118474', 'volume_size': 2}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20a75fa-4b6e-47a5-af9c-af370add4aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20a75fa-4b6e-47a5-af9c-af370add4aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0a795c-b077-4ddc-ad7d-1239a2f5436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:32 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Volume 610c7312-d484-49e9-9841-c77000118474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610c7312-d484-49e9-9841-c77000118474', 'volume_size': 2}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1793959223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610c7312-d484-49e9-9841-c77000118474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1717dec4e9ba42fdb478efb75e26c701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:47:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:47:32Z,use_quota=True,user_id='e74ebe27d4f04b91a520912947a7f84a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Creating volume 610c7312-d484-49e9-9841-c77000118474 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:47:32 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:47:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-610c7312-d484-49e9-9841-c77000118474 2147483648 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:32 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=74, name=volume-610c7312-d484-49e9-9841-c77000118474, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:47:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-610c7312-d484-49e9-9841-c77000118474 2147483648" returned: 0 in 0.680s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-610c7312-d484-49e9-9841-c77000118474 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-610c7312-d484-49e9-9841-c77000118474" returned: 0 in 0.115s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] <== create_volume: return (903ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:47:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0a795c-b077-4ddc-ad7d-1239a2f5436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610c7312-d484-49e9-9841-c77000118474', 'volume_size': 2}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d4d6f7-3485-493b-a7fa-ae2f28c549de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:34 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Volume volume-610c7312-d484-49e9-9841-c77000118474 (610c7312-d484-49e9-9841-c77000118474): created successfully
Sep 17 19:47:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d4d6f7-3485-493b-a7fa-ae2f28c549de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Flow 'volume_create_manager' (9bbe8321-0c9b-41d8-9884-7242fae1164e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:47:34 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7b52e799-b573-462e-8a85-c5db633fc4fd tempest-VolumesCloneNegativeTest-742115282 None] Created volume successfully.
Sep 17 19:47:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Acquiring lock "cinder-610c7312-d484-49e9-9841-c77000118474-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:47:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Lock "cinder-610c7312-d484-49e9-9841-c77000118474-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:47:35 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Acquiring lock "cinder-quobyte-610c7312-d484-49e9-9841-c77000118474" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:47:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Lock "cinder-quobyte-610c7312-d484-49e9-9841-c77000118474" acquired by "delete_volume" :: waited 0.024s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:47:35 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[218ed807-037e-4b85-be73-d33c7a9c0918]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-610c7312-d484-49e9-9841-c77000118474 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-610c7312-d484-49e9-9841-c77000118474" returned: 0 in 0.579s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-610c7312-d484-49e9-9841-c77000118474 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-610c7312-d484-49e9-9841-c77000118474" returned: 0 in 0.134s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Lock "cinder-quobyte-610c7312-d484-49e9-9841-c77000118474" released by "delete_volume" :: held 1.050s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Created reservations ['264688cb-1cb7-4cb5-8ea3-7e158e4d6e3e', '267d5450-d7d7-4c14-8195-1bcbc7a9b7ac', 'bc43127e-b541-4992-8461-8bfc9c6b5f5e', '3d20a475-dea4-40b8-b7e8-d746a45bde8b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.098s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:36 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:47:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Deleted volume successfully.
Sep 17 19:47:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1ddd2db9-b1b8-4b8e-bac0-878870abd640 tempest-VolumesCloneNegativeTest-742115282 None] Lock "cinder-610c7312-d484-49e9-9841-c77000118474-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:47:41 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Flow 'volume_create_manager' (dd0faa5a-d67a-4ec6-9d72-f40d6b389009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8510b9fd-ccb9-4ced-aad3-acef52f3ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8510b9fd-ccb9-4ced-aad3-acef52f3ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1384139659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95253df4-998b-4456-a5a0-c3cf30a32dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42b0eb8b1ef4e46b6ca05dd9c891cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:47:41Z,use_quota=True,user_id='1c708519c3f4408f89d67c6b87b19aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9e2e36-d164-4601-9e4c-3773a2c6597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9e2e36-d164-4601-9e4c-3773a2c6597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d19ed3-0c3c-43ba-9499-efd48d3a059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.image.glance [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Creating Keystone auth plugin from conf {{(pid=83122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d19ed3-0c3c-43ba-9499-efd48d3a059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95253df4-998b-4456-a5a0-c3cf30a32dd2', 'volume_name': 'volume-95253df4-998b-4456-a5a0-c3cf30a32dd2', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842d3b1990>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0e6467-772e-4825-b4c4-7c1d82a0a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0e6467-772e-4825-b4c4-7c1d82a0a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a828e30c-2325-418d-ad9b-44098bc6a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:41 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Volume 95253df4-998b-4456-a5a0-c3cf30a32dd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95253df4-998b-4456-a5a0-c3cf30a32dd2', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842d3b1990>}
Sep 17 19:47:41 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Cloning 95253df4-998b-4456-a5a0-c3cf30a32dd2 from image 5aeb2b61-d870-4c21-9c73-400584a484f7  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]). {{(pid=83122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 19:47:42 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 19:47:42 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 19:47:42 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1383e6a-2552-4257-bd42-7299cc7b07e5]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:42 devstack sudo[95393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD
Sep 17 19:47:42 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:47:44 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root
Sep 17 19:47:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD" returned: 0 in 2.191s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:44 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Temporary image 5aeb2b61-d870-4c21-9c73-400584a484f7 is fetched for user 1c708519c3f4408f89d67c6b87b19aa6. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 19:47:45 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3571312b-618d-462a-975d-8e132fe54305]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:45 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD
Sep 17 19:47:45 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:47:47 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD" returned: 0 in 2.407s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1384139659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95253df4-998b-4456-a5a0-c3cf30a32dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42b0eb8b1ef4e46b6ca05dd9c891cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:47:41Z,use_quota=True,user_id='1c708519c3f4408f89d67c6b87b19aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Creating volume 95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:47:47 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:47:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:47 devstack quobyte-client[83143]: System call of process 95404 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:47:47 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=75, name=volume-95253df4-998b-4456-a5a0-c3cf30a32dd2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 1073741824" returned: 0 in 0.452s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 0 in 0.106s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] <== create_volume: return (679ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Attempting download of 5aeb2b61-d870-4c21-9c73-400584a484f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}])) to volume 95253df4-998b-4456-a5a0-c3cf30a32dd2. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dfb6e0-b86e-4893-b8c8-e45c31a5921c]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_n7mcx5f_ {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_n7mcx5f_" returned: 0 in 0.338s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_n7mcx5f_ {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_n7mcx5f_" returned: 1 in 0.394s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_n7mcx5f_' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:47:49 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2577c9a1-7706-4ea4-a8dd-ee1f95d28a7a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:49 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] 5aeb2b61-d870-4c21-9c73-400584a484f7 was qcow2, converting to raw {{(pid=83122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 19:47:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:50 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=75, name=volume-95253df4-998b-4456-a5a0-c3cf30a32dd2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:47:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 0 in 2.107s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:51 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_33odp90rdevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:47:52 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Converted 112.00 MB image at 52.21 MB/s
Sep 17 19:47:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:52 devstack quobyte-client[83143]: System call of process 95467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:47:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 1G" returned: 0 in 0.197s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:52 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[04350802-a13d-41d4-8512-39ead9b9469f]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:53 devstack quobyte-client[83143]: System call of process 95472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:47:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c2308e98-4cce-402b-8e89-f077a0914195 req-2a611603-99da-4660-8ed5-4a7514db2594 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 0 in 1.236s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:54 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c2308e98-4cce-402b-8e89-f077a0914195 req-2a611603-99da-4660-8ed5-4a7514db2594 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:54 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-c2308e98-4cce-402b-8e89-f077a0914195 req-2a611603-99da-4660-8ed5-4a7514db2594 tempest-AttachVolumeNegativeTest-1241069812 None] Terminate volume connection completed successfully.
Sep 17 19:47:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c2308e98-4cce-402b-8e89-f077a0914195 req-2a611603-99da-4660-8ed5-4a7514db2594 tempest-AttachVolumeNegativeTest-1241069812 None] Deleting attachment 0af87ae4-255f-4243-8fef-6c1ec6f26069. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:47:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:47:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:47:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:47:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:47:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:54 devstack quobyte-client[83143]: System call of process 95484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 1 in 1.457s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.565s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Downloaded image 5aeb2b61-d870-4c21-9c73-400584a484f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}])) to volume 95253df4-998b-4456-a5a0-c3cf30a32dd2 successfully. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Temporary image 5aeb2b61-d870-4c21-9c73-400584a484f7 for user 1c708519c3f4408f89d67c6b87b19aa6 is deleted. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Marking volume 95253df4-998b-4456-a5a0-c3cf30a32dd2 as bootable. {{(pid=83122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Copying metadata from image 5aeb2b61-d870-4c21-9c73-400584a484f7 to 95253df4-998b-4456-a5a0-c3cf30a32dd2. {{(pid=83122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Creating volume glance metadata for volume 95253df4-998b-4456-a5a0-c3cf30a32dd2 backed by image 5aeb2b61-d870-4c21-9c73-400584a484f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a828e30c-2325-418d-ad9b-44098bc6a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95253df4-998b-4456-a5a0-c3cf30a32dd2', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842d3b1990>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3580b110-dde1-43ba-95ef-9de27430279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:47:55 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Volume volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 (95253df4-998b-4456-a5a0-c3cf30a32dd2): created successfully
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3580b110-dde1-43ba-95ef-9de27430279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:47:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Flow 'volume_create_manager' (dd0faa5a-d67a-4ec6-9d72-f40d6b389009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:47:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-790b43da-9c84-4818-98e8-ad479f7741b4 tempest-VolumesExtendTest-1258982377 None] Created volume successfully.
Sep 17 19:47:56 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:47:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:47:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:47:56 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c97c158-27e8-438f-8586-245fe5be4640]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:47:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:57 devstack quobyte-client[83143]: System call of process 95511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:47:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 0 in 1.104s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:59 devstack quobyte-client[83143]: System call of process 95578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:47:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 1 in 1.227s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:47:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 2G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:47:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 2G" returned: 0 in 0.404s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:47:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.116s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:00 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b3698a61-1940-432a-b7dc-93f0db5cb5e6 tempest-VolumesExtendTest-1258982377 None] Extend volume completed successfully.
Sep 17 19:48:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "cinder-95253df4-998b-4456-a5a0-c3cf30a32dd2-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-95253df4-998b-4456-a5a0-c3cf30a32dd2-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:02 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "cinder-quobyte-95253df4-998b-4456-a5a0-c3cf30a32dd2" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-quobyte-95253df4-998b-4456-a5a0-c3cf30a32dd2" acquired by "delete_volume" :: waited 0.026s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:02 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b90528-f71c-4f20-b803-dd95d964c3e6]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 0 in 1.011s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 1 in 0.625s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:48:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-95253df4-998b-4456-a5a0-c3cf30a32dd2" returned: 0 in 0.107s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-quobyte-95253df4-998b-4456-a5a0-c3cf30a32dd2" released by "delete_volume" :: held 2.275s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:05 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Created reservations ['4f23097f-6f8e-46aa-9ff3-a7e8228f3cc7', 'a316f7c1-3595-4ba8-b5e2-94663470ab74', '9d476485-76d6-4b23-8c2d-7be748eefeb8', '0a2cff4e-8c8a-4274-a803-f892bcb089f3'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:48:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:48:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:48:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.279s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:06 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:48:06 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Deleted volume successfully.
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-aa55da70-e11f-410f-898a-6bf45bce1798 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-95253df4-998b-4456-a5a0-c3cf30a32dd2-delete_volume" released by "delete_volume" :: held 4.943s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=42,cinder:UPDATE=29,cinder:INSERT=17,cinder:DELETE=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=41,cinder:UPDATE=48,cinder:DELETE=3,cinder:INSERT=8 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:48:07 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Flow 'volume_create_manager' (3f2ffdc4-791f-453c-9b3a-4e1f97b92a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94305596-1026-4976-83a7-74d948fabafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94305596-1026-4976-83a7-74d948fabafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-508647831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73e7442-49a2-459c-ab9d-d5c8eb5c5fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42b0eb8b1ef4e46b6ca05dd9c891cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:48:07Z,use_quota=True,user_id='1c708519c3f4408f89d67c6b87b19aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f1ea07-c323-4d37-a3cf-186d398ce013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f1ea07-c323-4d37-a3cf-186d398ce013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f61776-545f-410f-a6c0-4707429d4ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f61776-545f-410f-a6c0-4707429d4ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73e7442-49a2-459c-ab9d-d5c8eb5c5fab', 'volume_name': 'volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22f0a24-9ec2-4a48-a698-72c04ea703d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22f0a24-9ec2-4a48-a698-72c04ea703d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487fde03-baf0-4dc8-ae5e-39a730b9ec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:07 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Volume d73e7442-49a2-459c-ab9d-d5c8eb5c5fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab', 'volume_size': 1}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-508647831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73e7442-49a2-459c-ab9d-d5c8eb5c5fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42b0eb8b1ef4e46b6ca05dd9c891cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:48:07Z,use_quota=True,user_id='1c708519c3f4408f89d67c6b87b19aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Creating volume d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:48:07 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:48:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:07 devstack quobyte-client[83143]: System call of process 95983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:48:07 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=76, name=volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:48:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab 1073741824" returned: 0 in 0.468s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" returned: 0 in 0.089s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] <== create_volume: return (703ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:48:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487fde03-baf0-4dc8-ae5e-39a730b9ec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb649c6-4f64-4146-88a9-435c485e3255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:09 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Volume volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab (d73e7442-49a2-459c-ab9d-d5c8eb5c5fab): created successfully
Sep 17 19:48:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb649c6-4f64-4146-88a9-435c485e3255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Flow 'volume_create_manager' (3f2ffdc4-791f-453c-9b3a-4e1f97b92a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:48:09 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-5c708d7b-ff66-461d-93e2-614dfb08c675 tempest-VolumesExtendTest-1258982377 None] Created volume successfully.
Sep 17 19:48:11 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Creating offline snapshot 51f7e282-4c39-4278-a944-491f29f2abc5 of volume d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:48:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1441030a-0357-4c65-ba90-99d795627bff]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:12 devstack quobyte-client[83143]: System call of process 96039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:48:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" returned: 0 in 1.049s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:12 devstack quobyte-client[83143]: System call of process 96045 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:48:12 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=77, name=volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:48:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 1G" returned: 0 in 0.515s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img rebase -u -b volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5" returned: 0 in 0.753s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:48:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5" returned: 0 in 0.129s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5" returned: 0 in 0.168s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.info" returned: 0 in 0.281s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.info" returned: 0 in 0.178s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.878s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-60b81a4a-f0b2-4944-9142-029429851f79 tempest-VolumesExtendTest-1258982377 None] Create snapshot completed successfully
Sep 17 19:48:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:16 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674fbb4-6c20-4dcc-bcae-8b2d5558f097]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" returned: 0 in 1.349s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 2G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 2G" returned: 0 in 0.293s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.777s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:18 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6ea5e1df-00ae-4da2-802f-ceb159aee2f6 tempest-VolumesExtendTest-1258982377 None] Extend volume completed successfully.
Sep 17 19:48:19 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "cinder-51f7e282-4c39-4278-a944-491f29f2abc5-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-51f7e282-4c39-4278-a944-491f29f2abc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "cinder-quobyte-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-quobyte-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Acquiring lock "cinder-quobyte-51f7e282-4c39-4278-a944-491f29f2abc5" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-quobyte-51f7e282-4c39-4278-a944-491f29f2abc5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Deleting offline snapshot 51f7e282-4c39-4278-a944-491f29f2abc5 of volume d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] snapshot_file for this snap is: volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcc5277-3bae-4560-8585-e1fbca31fe2d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5" returned: 0 in 0.576s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cef4ba-0af2-411a-82c2-d40e2a8be6d7]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" returned: 0 in 0.601s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5" returned: 0 in 0.262s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab.51f7e282-4c39-4278-a944-491f29f2abc5" returned: 0 in 0.110s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-quobyte-51f7e282-4c39-4278-a944-491f29f2abc5" released by "_delete_snapshot" :: held 1.956s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-quobyte-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" released by "delete_snapshot" :: held 1.987s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:22 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Created reservations ['da35293d-ef5a-417b-a0a4-2cc960ef6456', '537cd72a-5eac-45c8-a47d-0671a3307d1f', '473ffce9-80a2-42b3-94c0-d58a4d904b46', 'a9a3125f-762b-43e3-8adc-8d036e22f0ce'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:48:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Delete snapshot completed successfully.
Sep 17 19:48:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1f3ac187-2aa8-4866-a52a-49e0a2e10371 tempest-VolumesExtendTest-1258982377 None] Lock "cinder-51f7e282-4c39-4278-a944-491f29f2abc5-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Acquiring lock "cinder-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Lock "cinder-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Acquiring lock "cinder-quobyte-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Lock "cinder-quobyte-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" acquired by "delete_volume" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:23 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1cbff0-6aaf-4578-ad86-7d7ce8750a05]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" returned: 0 in 0.443s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" returned: 0 in 0.112s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Lock "cinder-quobyte-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab" released by "delete_volume" :: held 0.758s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Created reservations ['52aa9f18-5ff4-45ed-b669-844169077791', '010f5e4e-2196-488e-bebf-1c2c2cbafc75', 'c84ffa0f-b74b-443c-a083-4429f968faa1', '700a59bf-b9f1-40ce-b775-711a852e475c'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.092s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:24 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:48:24 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Deleted volume successfully.
Sep 17 19:48:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3cd5943b-4268-4033-94bd-ecffbac29c1c tempest-VolumesExtendTest-1258982377 None] Lock "cinder-d73e7442-49a2-459c-ab9d-d5c8eb5c5fab-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Flow 'volume_create_manager' (b56cb60c-00b0-4ea7-839d-9c48dc253b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef370da-cb0a-46d7-bca7-6bb4b1a936d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef370da-cb0a-46d7-bca7-6bb4b1a936d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-232934188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00af9424-652c-49f4-a940-42ab37c9b9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf9c45f56bd4de893b481734113dd57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:48:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:48:33Z,use_quota=True,user_id='9cecc08aab244a4faa9c4373a7d7237b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cccc51f-0205-408c-86a2-26e2894ca243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cccc51f-0205-408c-86a2-26e2894ca243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20a0ff1-4186-4d07-9547-926798fcba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20a0ff1-4186-4d07-9547-926798fcba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00af9424-652c-49f4-a940-42ab37c9b9c6', 'volume_name': 'volume-00af9424-652c-49f4-a940-42ab37c9b9c6', 'volume_size': 2}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a9b30a-be8f-4070-9932-dd7296594cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a9b30a-be8f-4070-9932-dd7296594cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c582e71-6d9c-46cf-b5aa-83f1808ff81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:33 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Volume 00af9424-652c-49f4-a940-42ab37c9b9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00af9424-652c-49f4-a940-42ab37c9b9c6', 'volume_size': 2}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-232934188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00af9424-652c-49f4-a940-42ab37c9b9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf9c45f56bd4de893b481734113dd57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:48:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:48:33Z,use_quota=True,user_id='9cecc08aab244a4faa9c4373a7d7237b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Creating volume 00af9424-652c-49f4-a940-42ab37c9b9c6 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:48:33 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:48:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 2147483648 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:34 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=79, name=volume-00af9424-652c-49f4-a940-42ab37c9b9c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:48:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 2147483648" returned: 0 in 0.657s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6" returned: 0 in 0.231s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] <== create_volume: return (1065ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:48:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c582e71-6d9c-46cf-b5aa-83f1808ff81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00af9424-652c-49f4-a940-42ab37c9b9c6', 'volume_size': 2}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3b437b-21ec-4a3a-b92f-1f40b2a3eca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:48:35 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Volume volume-00af9424-652c-49f4-a940-42ab37c9b9c6 (00af9424-652c-49f4-a940-42ab37c9b9c6): created successfully
Sep 17 19:48:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3b437b-21ec-4a3a-b92f-1f40b2a3eca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:48:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Flow 'volume_create_manager' (b56cb60c-00b0-4ea7-839d-9c48dc253b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:48:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e967b0eb-f7c9-44c4-9449-2d2d8cd37112 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Created volume successfully.
Sep 17 19:48:36 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Creating offline snapshot 0d45150c-7cf2-47c4-ab6e-9b34d5083a8c of volume 00af9424-652c-49f4-a940-42ab37c9b9c6 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:48:36 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce486d5f-6cd6-48e3-bcc9-550a08b1c56d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6" returned: 0 in 0.520s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c 2G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:37 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=80, name=volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:48:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c 2G" returned: 0 in 0.442s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): qemu-img rebase -u -b volume-00af9424-652c-49f4-a940-42ab37c9b9c6 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "qemu-img rebase -u -b volume-00af9424-652c-49f4-a940-42ab37c9b9c6 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" returned: 0 in 0.257s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:48:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" returned: 0 in 0.117s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:48:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" returned: 0 in 0.095s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.info" returned: 0 in 0.210s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:38 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:48:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.info" returned: 0 in 0.221s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:39 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3e22be09-fc55-4efd-9c9b-191e851da4f4 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Create snapshot completed successfully
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "cinder-0d45150c-7cf2-47c4-ab6e-9b34d5083a8c-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-0d45150c-7cf2-47c4-ab6e-9b34d5083a8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:39 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "cinder-quobyte-00af9424-652c-49f4-a940-42ab37c9b9c6" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-quobyte-00af9424-652c-49f4-a940-42ab37c9b9c6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "cinder-quobyte-0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-quobyte-0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Deleting offline snapshot 0d45150c-7cf2-47c4-ab6e-9b34d5083a8c of volume 00af9424-652c-49f4-a940-42ab37c9b9c6 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] snapshot_file for this snap is: volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb451f77-50d9-4953-b008-1cf05ce01131]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" returned: 0 in 0.557s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00af9424-652c-49f4-a940-42ab37c9b9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:48:40 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e816f-0eef-4968-bd40-984bad45b891]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:41 devstack quobyte-client[83143]: System call of process 96208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:48:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6" returned: 0 in 1.283s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:42 devstack quobyte-client[83143]: System call of process 96229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:48:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" returned: 0 in 1.033s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6.0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" returned: 0 in 0.678s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-quobyte-0d45150c-7cf2-47c4-ab6e-9b34d5083a8c" released by "_delete_snapshot" :: held 4.310s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-quobyte-00af9424-652c-49f4-a940-42ab37c9b9c6" released by "delete_snapshot" :: held 4.358s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:45 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Created reservations ['8a5b76d3-acf0-4a97-9a55-745107298499', 'a0d1f52b-3da5-4773-80d9-8f943f3049ef', 'b9288ed6-5de5-4ba5-91cd-7777cd2d531d', '926f46c8-7a8c-4e98-a718-864f88b953f6'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:48:45 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Delete snapshot completed successfully.
Sep 17 19:48:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4d536ce-53dd-4904-9e4b-7201c4bd9bc9 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-0d45150c-7cf2-47c4-ab6e-9b34d5083a8c-delete_snapshot" released by "delete_snapshot" :: held 5.458s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "cinder-00af9424-652c-49f4-a940-42ab37c9b9c6-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-00af9424-652c-49f4-a940-42ab37c9b9c6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:48:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "cinder-quobyte-00af9424-652c-49f4-a940-42ab37c9b9c6" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:48:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-quobyte-00af9424-652c-49f4-a940-42ab37c9b9c6" acquired by "delete_volume" :: waited 0.045s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:48:46 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a168b-9428-463e-b5c4-5948ad361940]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:48:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:47 devstack quobyte-client[83143]: System call of process 96271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:48:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6" returned: 0 in 0.971s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-00af9424-652c-49f4-a940-42ab37c9b9c6" returned: 0 in 0.185s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:47 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-quobyte-00af9424-652c-49f4-a940-42ab37c9b9c6" released by "delete_volume" :: held 1.547s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Created reservations ['84b4f5e1-b218-4184-8432-a8e987785a8f', 'da2e60fb-521f-4ef9-94c7-86951d5a4584', '8c13e18e-d936-4091-ae3d-79d690e63fde', 'c97ab8b5-42ce-4eac-81c7-396772ac6ffb'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.114s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:48 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:48:48 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Deleted volume successfully.
Sep 17 19:48:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad6e7974-c3be-4681-99a7-01a6f1f08517 tempest-VolumesSnapshotNegativeTestJSON-59244432 None] Lock "cinder-00af9424-652c-49f4-a940-42ab37c9b9c6-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.367s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:48:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:48:58 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=54,cinder:DELETE=1,cinder:SELECT=31,cinder:INSERT=9 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:48:59 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=19,cinder:UPDATE=16,cinder:DELETE=5,cinder:INSERT=7 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:49:41 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:49:41 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:49:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Flow 'volume_create_manager' (15b443bc-18fc-4098-8bd0-6d999e3bd72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:49:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba729a14-73b4-4050-8760-5d2282434595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:49:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba729a14-73b4-4050-8760-5d2282434595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2095648011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ceb223c308402eb3885a87371626c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:49:42Z,use_quota=True,user_id='73b09b5bc9e84df6b8f2f463caea028d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:49:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af73fddf-789d-439c-b0ea-c7904077a5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:49:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af73fddf-789d-439c-b0ea-c7904077a5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:49:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de0b9c6-465b-44ab-8da3-1a9a8813a9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:49:41 devstack cinder-volume[83122]: DEBUG cinder.image.glance [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Creating Keystone auth plugin from conf {{(pid=83122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 19:49:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de0b9c6-465b-44ab-8da3-1a9a8813a9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8', 'volume_name': 'volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8422a8a3e0>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:49:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cba4d3-50cf-41ab-b8e4-17ec0a1b545a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:49:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cba4d3-50cf-41ab-b8e4-17ec0a1b545a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:49:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fef97f9-a4d8-4ea2-8b0f-2125160e5d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:49:42 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Volume 8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8422a8a3e0>}
Sep 17 19:49:42 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Cloning 8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 from image 5aeb2b61-d870-4c21-9c73-400584a484f7  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]). {{(pid=83122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 19:49:42 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 19:49:42 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 19:49:43 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da94687f-573d-47e3-8063-74ffda207783]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:49:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:43 devstack sudo[96437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD
Sep 17 19:49:43 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:49:45 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root
Sep 17 19:49:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD" returned: 0 in 2.239s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:45 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Temporary image 5aeb2b61-d870-4c21-9c73-400584a484f7 is fetched for user 73b09b5bc9e84df6b8f2f463caea028d. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 19:49:45 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a6d940-538d-46e6-a792-7c3259ae4a7d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:49:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:46 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD
Sep 17 19:49:46 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:49:47 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Sep 17 19:49:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD" returned: 0 in 2.309s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:49:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:49:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2095648011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ceb223c308402eb3885a87371626c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:49:42Z,use_quota=True,user_id='73b09b5bc9e84df6b8f2f463caea028d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:49:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Creating volume 8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:49:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:49:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:49:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:49:48 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:48 devstack quobyte-client[83143]: System call of process 96459 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:49:48 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=82, name=volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 1073741824" returned: 0 in 0.432s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 0 in 0.098s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] <== create_volume: return (638ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:49:48 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Attempting download of 5aeb2b61-d870-4c21-9c73-400584a484f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}])) to volume 8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 19:49:49 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7982e43b-a9b6-43ab-ba15-0b75ed2ec71c]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:49:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_3di7smrl {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_3di7smrl" returned: 0 in 0.455s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_3di7smrl {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_3di7smrl" returned: 1 in 0.434s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_3di7smrl' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:49:50 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5627062-c406-4206-8116-69847cd1e914]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:49:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:50 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] 5aeb2b61-d870-4c21-9c73-400584a484f7 was qcow2, converting to raw {{(pid=83122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 19:49:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:50 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=82, name=volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:49:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 0 in 1.123s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:51 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_pqxa32tadevstack@QuobyteHD, size 112.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:49:51 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Converted 112.00 MB image at 97.03 MB/s
Sep 17 19:49:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 1G" returned: 0 in 0.172s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:51 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e2a3b-2cd4-4bb1-a6f6-68a915b2f982]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:49:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 0 in 0.425s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 1 in 0.424s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:49:52 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Downloaded image 5aeb2b61-d870-4c21-9c73-400584a484f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}])) to volume 8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 successfully. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 19:49:52 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Temporary image 5aeb2b61-d870-4c21-9c73-400584a484f7 for user 73b09b5bc9e84df6b8f2f463caea028d is deleted. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 19:49:52 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Marking volume 8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 as bootable. {{(pid=83122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 19:49:53 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Copying metadata from image 5aeb2b61-d870-4c21-9c73-400584a484f7 to 8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8. {{(pid=83122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 19:49:53 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Creating volume glance metadata for volume 8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 backed by image 5aeb2b61-d870-4c21-9c73-400584a484f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 19:49:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fef97f9-a4d8-4ea2-8b0f-2125160e5d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8422a8a3e0>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:49:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b760deeb-e44e-41c2-94cf-e68e5641d9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:49:53 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Volume volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 (8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8): created successfully
Sep 17 19:49:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b760deeb-e44e-41c2-94cf-e68e5641d9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:49:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Flow 'volume_create_manager' (15b443bc-18fc-4098-8bd0-6d999e3bd72d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:49:53 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6c9f0b6a-2a95-4ab3-8643-23dd690445bf tempest-TestShelveInstance-488807433 None] Created volume successfully.
Sep 17 19:49:54 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-89de4e18-cb5d-4da4-98b1-28f76560cfa8 req-8280fc58-8b05-4857-8060-2d8662458978 tempest-TestMinimumBasicScenario-2022978301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:49:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-89de4e18-cb5d-4da4-98b1-28f76560cfa8 req-8280fc58-8b05-4857-8060-2d8662458978 tempest-TestMinimumBasicScenario-2022978301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:49:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-89de4e18-cb5d-4da4-98b1-28f76560cfa8 req-8280fc58-8b05-4857-8060-2d8662458978 tempest-TestMinimumBasicScenario-2022978301 None] Terminate volume connection completed successfully.
Sep 17 19:49:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-89de4e18-cb5d-4da4-98b1-28f76560cfa8 req-8280fc58-8b05-4857-8060-2d8662458978 tempest-TestMinimumBasicScenario-2022978301 None] Deleting attachment 8962c52e-29c2-463b-bbff-cf3ef0bbfe70. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:49:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Acquiring lock "cinder-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:49:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Lock "cinder-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:49:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:49:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Acquiring lock "cinder-quobyte-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:49:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Lock "cinder-quobyte-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4" acquired by "delete_volume" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:49:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb224a-0f41-4e1f-bb79-5b9e2f148baf]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:49:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4" returned: 0 in 0.539s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4" returned: 0 in 0.213s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Lock "cinder-quobyte-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4" released by "delete_volume" :: held 1.074s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Created reservations ['b8780fe2-0d0b-4234-8309-c868aff799d9', 'd291b44d-412c-4b59-a084-4f7ae934c1eb', '0931d6ac-8066-449e-869d-ef730e5cd020', '9680ebd1-a545-4aca-80bb-b713b17c6351'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.516s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:49:59 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:50:00 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Deleted volume successfully.
Sep 17 19:50:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-059819c7-a66e-4c08-b30c-fa3d90c5308e tempest-TestMinimumBasicScenario-2022978301 None] Lock "cinder-f8f7dbe0-0c85-4d54-9cb6-c7ea11add7c4-delete_volume" released by "delete_volume" :: held 3.458s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:50:05 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Flow 'volume_create_manager' (73034ad0-2e13-4304-b3e2-d0e8ee6e4dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00b5a55-0e4c-429e-b584-b8ac7ff64b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00b5a55-0e4c-429e-b584-b8ac7ff64b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-475147279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f58643-497c-4e79-b8c6-ed470752982b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc774e5279cd49ae9ba0f4b247631856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:50:05Z,use_quota=True,user_id='d846be0f4d7d430aad9f4ead0735779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033d9406-991f-4d07-961c-757c93c0a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033d9406-991f-4d07-961c-757c93c0a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e517434-5cfa-42ee-9466-f23078849fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e517434-5cfa-42ee-9466-f23078849fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f58643-497c-4e79-b8c6-ed470752982b', 'volume_name': 'volume-d0f58643-497c-4e79-b8c6-ed470752982b', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bf9b88-fdc7-4e7e-be12-dda7ce1241b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bf9b88-fdc7-4e7e-be12-dda7ce1241b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cfee09-867d-4eff-81c8-51a0a3ee42b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:50:05 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Volume d0f58643-497c-4e79-b8c6-ed470752982b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f58643-497c-4e79-b8c6-ed470752982b', 'volume_size': 1}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-475147279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f58643-497c-4e79-b8c6-ed470752982b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc774e5279cd49ae9ba0f4b247631856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:50:05Z,use_quota=True,user_id='d846be0f4d7d430aad9f4ead0735779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Creating volume d0f58643-497c-4e79-b8c6-ed470752982b {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:50:05 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:50:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:50:06 devstack quobyte-client[83143]: System call of process 96569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:50:06 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=83, name=volume-d0f58643-497c-4e79-b8c6-ed470752982b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:50:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b 1073741824" returned: 0 in 1.072s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:50:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:50:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b" returned: 0 in 0.152s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:50:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] <== create_volume: return (1350ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:50:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:50:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cfee09-867d-4eff-81c8-51a0a3ee42b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f58643-497c-4e79-b8c6-ed470752982b', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:50:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe42294-b0a7-4b64-93af-35564d2f452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:50:07 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Volume volume-d0f58643-497c-4e79-b8c6-ed470752982b (d0f58643-497c-4e79-b8c6-ed470752982b): created successfully
Sep 17 19:50:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe42294-b0a7-4b64-93af-35564d2f452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:50:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Flow 'volume_create_manager' (73034ad0-2e13-4304-b3e2-d0e8ee6e4dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:50:07 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7af5f846-54bd-441a-a6e4-d1154a64e687 tempest-AttachVolumeNegativeTest-1241069812 None] Created volume successfully.
Sep 17 19:50:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:50:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:50:08 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b0d3d5-a098-49b4-9e74-64591d47f3b2]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:50:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:50:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 0 in 0.590s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:50:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:50:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 1 in 0.503s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:50:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:50:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.275s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:50:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e162344d-3f38-4f88-bb30-6ca21f6e22af', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:50:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:50:10 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-6f78a990-e138-43b1-98ca-751c45534ea8 req-36dd8a2a-a679-4fef-ba1d-c532a169fe89 tempest-TestShelveInstance-488807433 None] attachment_update completed successfully.
Sep 17 19:50:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-6bf19360-4ccd-4fba-ad2d-5564fe3d49bc req-8770440e-79c7-4582-a5e2-5eb6a75450c8 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:50:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-6bf19360-4ccd-4fba-ad2d-5564fe3d49bc req-8770440e-79c7-4582-a5e2-5eb6a75450c8 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:50:13 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec2b445-8cbe-4af2-bb8b-47690969387d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:50:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-6bf19360-4ccd-4fba-ad2d-5564fe3d49bc req-8770440e-79c7-4582-a5e2-5eb6a75450c8 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:50:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-6bf19360-4ccd-4fba-ad2d-5564fe3d49bc req-8770440e-79c7-4582-a5e2-5eb6a75450c8 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b" returned: 0 in 0.697s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:50:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-6bf19360-4ccd-4fba-ad2d-5564fe3d49bc req-8770440e-79c7-4582-a5e2-5eb6a75450c8 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:50:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-6bf19360-4ccd-4fba-ad2d-5564fe3d49bc req-8770440e-79c7-4582-a5e2-5eb6a75450c8 tempest-AttachVolumeNegativeTest-1241069812 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-d0f58643-497c-4e79-b8c6-ed470752982b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e49783ea-3603-4ef1-97d8-d7a45ab36294', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:50:14 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-6bf19360-4ccd-4fba-ad2d-5564fe3d49bc req-8770440e-79c7-4582-a5e2-5eb6a75450c8 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:50:14 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-6bf19360-4ccd-4fba-ad2d-5564fe3d49bc req-8770440e-79c7-4582-a5e2-5eb6a75450c8 tempest-AttachVolumeNegativeTest-1241069812 None] attachment_update completed successfully.
Sep 17 19:50:24 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=9,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:50:24 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=31,cinder:INSERT=8,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:50:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-5d386f81-f3d9-442c-ad73-19eab05d9222 req-bcd933b4-f247-4efc-872c-3154c1daa589 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:50:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-5d386f81-f3d9-442c-ad73-19eab05d9222 req-bcd933b4-f247-4efc-872c-3154c1daa589 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:50:47 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-5d386f81-f3d9-442c-ad73-19eab05d9222 req-bcd933b4-f247-4efc-872c-3154c1daa589 tempest-AttachVolumeNegativeTest-1241069812 None] Terminate volume connection completed successfully.
Sep 17 19:50:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-5d386f81-f3d9-442c-ad73-19eab05d9222 req-bcd933b4-f247-4efc-872c-3154c1daa589 tempest-AttachVolumeNegativeTest-1241069812 None] Deleting attachment e49783ea-3603-4ef1-97d8-d7a45ab36294. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.261s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:50:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:50:57 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:50:57 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:51:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "cinder-d0f58643-497c-4e79-b8c6-ed470752982b-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-d0f58643-497c-4e79-b8c6-ed470752982b-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:05 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "cinder-quobyte-d0f58643-497c-4e79-b8c6-ed470752982b" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-quobyte-d0f58643-497c-4e79-b8c6-ed470752982b" acquired by "delete_volume" :: waited 0.025s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:05 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9191e3a-9400-402e-967c-f66e7550e18b]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:51:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:06 devstack quobyte-client[83143]: System call of process 97206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:51:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b" returned: 0 in 0.864s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d0f58643-497c-4e79-b8c6-ed470752982b" returned: 0 in 0.268s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-quobyte-d0f58643-497c-4e79-b8c6-ed470752982b" released by "delete_volume" :: held 1.520s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:07 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Created reservations ['63fe4c9f-1f4f-4fa9-9439-100e55fae627', '32e44737-6013-4b4e-83ad-d9a669ba095d', '213dc98c-7618-438e-baf0-93725869cffb', 'eb3d607a-4c5a-4be6-a247-91cc0101073a'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:51:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.143s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:08 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:51:08 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Deleted volume successfully.
Sep 17 19:51:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-53661734-026c-4597-a263-620a55c4b83d tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-d0f58643-497c-4e79-b8c6-ed470752982b-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "cinder-67839bf0-2df2-4525-bc73-8896fc116207-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-67839bf0-2df2-4525-bc73-8896fc116207-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:08 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "cinder-quobyte-67839bf0-2df2-4525-bc73-8896fc116207" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-quobyte-67839bf0-2df2-4525-bc73-8896fc116207" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:09 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcb5f6b-cb25-49ae-ae27-ece05e454b13]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:51:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:09 devstack quobyte-client[83143]: System call of process 97211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:51:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207" returned: 0 in 0.570s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-67839bf0-2df2-4525-bc73-8896fc116207" returned: 0 in 0.095s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-quobyte-67839bf0-2df2-4525-bc73-8896fc116207" released by "delete_volume" :: held 0.825s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Created reservations ['9ec8194d-a2d9-4df4-abc3-00e24b43b388', 'd1cc2654-a446-42a5-a8d0-6cd4a102cbf9', '71ed1e1a-bee5-4c7c-9547-f9d22987f46e', '251d6166-c3f3-42a2-a8f5-bd93385fbfd8'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.107s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:51:10 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Deleted volume successfully.
Sep 17 19:51:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-035e84c6-c05a-4d03-9360-7d8fb844e74f tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-67839bf0-2df2-4525-bc73-8896fc116207-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "cinder-d429cb09-877d-423b-b698-7e8c54f49fd8-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-d429cb09-877d-423b-b698-7e8c54f49fd8-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:11 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "cinder-quobyte-d429cb09-877d-423b-b698-7e8c54f49fd8" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-quobyte-d429cb09-877d-423b-b698-7e8c54f49fd8" acquired by "delete_volume" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[88581c75-d9aa-4a89-a567-cd54bf5ce333]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:51:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8" returned: 0 in 0.445s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d429cb09-877d-423b-b698-7e8c54f49fd8" returned: 0 in 0.101s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-quobyte-d429cb09-877d-423b-b698-7e8c54f49fd8" released by "delete_volume" :: held 0.717s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Created reservations ['3725498d-e5ef-4ce0-bc93-79af5644a449', 'c8a27c82-2ced-4496-9ca4-35ab6942e205', 'ae8cba72-ae6d-4c4c-8d30-d3f640afb0d2', '46a8c393-f4cd-44e7-89e2-94c608bdd1d7'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.091s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:12 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:51:13 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Deleted volume successfully.
Sep 17 19:51:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2531910f-6cee-4997-a002-d8cf1f5efe06 tempest-AttachVolumeNegativeTest-1241069812 None] Lock "cinder-d429cb09-877d-423b-b698-7e8c54f49fd8-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:22 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=21,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:51:23 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:51:29 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Flow 'volume_create_manager' (c01028c9-9c2c-4d58-8c72-4c8b6466931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d6e294-d701-48c4-b481-2b0c29c5ff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d6e294-d701-48c4-b481-2b0c29c5ff85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-522031079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3289a0-00ce-41ca-8267-59dbb4654159,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='430f308ca8c643d3a73fab6287d0c687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:51:29Z,use_quota=True,user_id='88cd97c165bc421aae5b8423b8a8c9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5d7e63-bd0d-4bb7-b3ed-c42c234a1134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5d7e63-bd0d-4bb7-b3ed-c42c234a1134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f83fa94-8e17-4b89-8d20-440cc886c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f83fa94-8e17-4b89-8d20-440cc886c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3289a0-00ce-41ca-8267-59dbb4654159', 'volume_name': 'volume-fd3289a0-00ce-41ca-8267-59dbb4654159', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7701856-b96d-4d70-948d-6b5eb64b03a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7701856-b96d-4d70-948d-6b5eb64b03a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25caa58-8554-438f-b69e-143d44ee10e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:29 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Volume fd3289a0-00ce-41ca-8267-59dbb4654159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3289a0-00ce-41ca-8267-59dbb4654159', 'volume_size': 1}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-522031079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3289a0-00ce-41ca-8267-59dbb4654159,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='430f308ca8c643d3a73fab6287d0c687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:51:29Z,use_quota=True,user_id='88cd97c165bc421aae5b8423b8a8c9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Creating volume fd3289a0-00ce-41ca-8267-59dbb4654159 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:51:29 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd3289a0-00ce-41ca-8267-59dbb4654159 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:29 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=84, name=volume-fd3289a0-00ce-41ca-8267-59dbb4654159, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd3289a0-00ce-41ca-8267-59dbb4654159 1073741824" returned: 0 in 0.520s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd3289a0-00ce-41ca-8267-59dbb4654159 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd3289a0-00ce-41ca-8267-59dbb4654159" returned: 0 in 0.224s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] <== create_volume: return (830ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:51:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25caa58-8554-438f-b69e-143d44ee10e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3289a0-00ce-41ca-8267-59dbb4654159', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546e8a8e-2f41-48d2-95d9-f8ae54a05d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:30 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Volume volume-fd3289a0-00ce-41ca-8267-59dbb4654159 (fd3289a0-00ce-41ca-8267-59dbb4654159): created successfully
Sep 17 19:51:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546e8a8e-2f41-48d2-95d9-f8ae54a05d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Flow 'volume_create_manager' (c01028c9-9c2c-4d58-8c72-4c8b6466931f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:51:30 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a2a568e7-ead1-4b04-b7e5-bd511135a3d1 tempest-VolumesTestJSON-577236283 None] Created volume successfully.
Sep 17 19:51:32 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Flow 'volume_create_manager' (d3d569e7-9718-4e20-ab41-53cd6a9a7f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6474459-1b57-43e9-9988-af524d06b639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6474459-1b57-43e9-9988-af524d06b639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1023404807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f86bca0-1892-4dd0-a193-3fee402ddd6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='430f308ca8c643d3a73fab6287d0c687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:51:32Z,use_quota=True,user_id='88cd97c165bc421aae5b8423b8a8c9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3c7ead-6f73-45b5-9dff-957ca3503959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3c7ead-6f73-45b5-9dff-957ca3503959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec7f7f1-2ed4-42bb-9d8c-e8cf05d66164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec7f7f1-2ed4-42bb-9d8c-e8cf05d66164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f86bca0-1892-4dd0-a193-3fee402ddd6c', 'volume_name': 'volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd24d960-e575-43ac-aeb9-b9d4c4cea42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd24d960-e575-43ac-aeb9-b9d4c4cea42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc4faa6-9e11-479d-a898-ddfbb352afd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:32 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Volume 7f86bca0-1892-4dd0-a193-3fee402ddd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c', 'volume_size': 1}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1023404807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f86bca0-1892-4dd0-a193-3fee402ddd6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='430f308ca8c643d3a73fab6287d0c687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:51:32Z,use_quota=True,user_id='88cd97c165bc421aae5b8423b8a8c9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Creating volume 7f86bca0-1892-4dd0-a193-3fee402ddd6c {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:51:32 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:32 devstack quobyte-client[83143]: System call of process 97303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:51:32 devstack quobyte-client[83143]: System call of process 97303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:51:32 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=85, name=volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c 1073741824" returned: 0 in 0.426s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c" returned: 0 in 0.103s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:51:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.613s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc4faa6-9e11-479d-a898-ddfbb352afd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9162a1db-bc17-4dd3-b0b3-44116df24d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:33 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Volume volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c (7f86bca0-1892-4dd0-a193-3fee402ddd6c): created successfully
Sep 17 19:51:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9162a1db-bc17-4dd3-b0b3-44116df24d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Flow 'volume_create_manager' (d3d569e7-9718-4e20-ab41-53cd6a9a7f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:51:33 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7e5b3d8f-f2c0-4511-8630-82818c1d1783 tempest-VolumesTestJSON-577236283 None] Created volume successfully.
Sep 17 19:51:34 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:34 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Flow 'volume_create_manager' (01aebb23-16d9-4e68-9bdf-b3aee2763b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c66cd0-97e4-40a0-81c2-e9f694b2822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c66cd0-97e4-40a0-81c2-e9f694b2822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-988314772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bcbd17-9f7f-46a1-903c-3ee04737a8d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='430f308ca8c643d3a73fab6287d0c687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:51:35Z,use_quota=True,user_id='88cd97c165bc421aae5b8423b8a8c9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f05bb5-51f5-41bd-bd49-c9b63150a5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f05bb5-51f5-41bd-bd49-c9b63150a5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687a5cfb-4d8d-4252-8aae-1c4734328663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687a5cfb-4d8d-4252-8aae-1c4734328663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68bcbd17-9f7f-46a1-903c-3ee04737a8d4', 'volume_name': 'volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63971a49-c65a-489d-9795-b4ab5f622b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63971a49-c65a-489d-9795-b4ab5f622b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f638f7-8434-4f7d-92cb-c78e254f084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:35 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Volume 68bcbd17-9f7f-46a1-903c-3ee04737a8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4', 'volume_size': 1}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-988314772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bcbd17-9f7f-46a1-903c-3ee04737a8d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='430f308ca8c643d3a73fab6287d0c687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:51:35Z,use_quota=True,user_id='88cd97c165bc421aae5b8423b8a8c9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Creating volume 68bcbd17-9f7f-46a1-903c-3ee04737a8d4 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:51:35 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:35 devstack quobyte-client[83143]: System call of process 97319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:51:35 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=86, name=volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4 1073741824" returned: 0 in 0.591s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4" returned: 0 in 0.133s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] <== create_volume: return (808ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:51:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f638f7-8434-4f7d-92cb-c78e254f084c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec554b6-4149-4ffc-840e-59b43cdc7fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:51:37 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Volume volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4 (68bcbd17-9f7f-46a1-903c-3ee04737a8d4): created successfully
Sep 17 19:51:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec554b6-4149-4ffc-840e-59b43cdc7fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:51:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Flow 'volume_create_manager' (01aebb23-16d9-4e68-9bdf-b3aee2763b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:51:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-53f28851-b67f-4cb5-9f14-214a87f23542 tempest-VolumesTestJSON-577236283 None] Created volume successfully.
Sep 17 19:51:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Acquiring lock "cinder-68bcbd17-9f7f-46a1-903c-3ee04737a8d4-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Lock "cinder-68bcbd17-9f7f-46a1-903c-3ee04737a8d4-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:41 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Acquiring lock "cinder-quobyte-68bcbd17-9f7f-46a1-903c-3ee04737a8d4" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Lock "cinder-quobyte-68bcbd17-9f7f-46a1-903c-3ee04737a8d4" acquired by "delete_volume" :: waited 0.018s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:41 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[97052cf7-dae0-4436-9721-f2139ed5eb35]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:51:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:42 devstack quobyte-client[83143]: System call of process 97387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:51:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4" returned: 0 in 1.100s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-68bcbd17-9f7f-46a1-903c-3ee04737a8d4" returned: 0 in 0.120s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Lock "cinder-quobyte-68bcbd17-9f7f-46a1-903c-3ee04737a8d4" released by "delete_volume" :: held 1.507s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:43 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Created reservations ['405e53d0-ee9a-4a0b-9cbf-15145340281a', 'fde95982-c889-4179-83a0-0d5373201c2f', '24866395-be68-4e42-9f97-0d7bdf5759b7', '21b832fc-8064-48d5-8efe-25c45dd424d1'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:51:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.148s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.551s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:44 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:51:44 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Deleted volume successfully.
Sep 17 19:51:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Acquiring lock "cinder-7f86bca0-1892-4dd0-a193-3fee402ddd6c-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Lock "cinder-7f86bca0-1892-4dd0-a193-3fee402ddd6c-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-240905ce-36f0-4899-8cc6-7c0b2b6a0b08 tempest-VolumesTestJSON-577236283 None] Lock "cinder-68bcbd17-9f7f-46a1-903c-3ee04737a8d4-delete_volume" released by "delete_volume" :: held 4.242s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:45 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Acquiring lock "cinder-quobyte-7f86bca0-1892-4dd0-a193-3fee402ddd6c" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Lock "cinder-quobyte-7f86bca0-1892-4dd0-a193-3fee402ddd6c" acquired by "delete_volume" :: waited 0.025s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:45 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7ff8cc-b0b3-44b5-a6ca-9350f1009c90]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:51:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c" returned: 0 in 0.684s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7f86bca0-1892-4dd0-a193-3fee402ddd6c" returned: 0 in 0.246s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Lock "cinder-quobyte-7f86bca0-1892-4dd0-a193-3fee402ddd6c" released by "delete_volume" :: held 1.209s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Created reservations ['822f6361-6ded-42fd-9433-8e07d5e59f7c', '20bf78ac-aea9-4686-a1e9-bd67ef6cc7fa', '2b2e03e2-3ca2-4bf8-9fe2-cbaa5cff478d', '89c8acd6-6fc6-4d48-8be0-9de0c1c777a2'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.119s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:51:47 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Deleted volume successfully.
Sep 17 19:51:47 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f33e65cc-6a2d-47f4-b5b5-d8aaaeb5035f tempest-VolumesTestJSON-577236283 None] Lock "cinder-7f86bca0-1892-4dd0-a193-3fee402ddd6c-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Acquiring lock "cinder-fd3289a0-00ce-41ca-8267-59dbb4654159-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Lock "cinder-fd3289a0-00ce-41ca-8267-59dbb4654159-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:48 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Acquiring lock "cinder-quobyte-fd3289a0-00ce-41ca-8267-59dbb4654159" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:51:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Lock "cinder-quobyte-fd3289a0-00ce-41ca-8267-59dbb4654159" acquired by "delete_volume" :: waited 0.023s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:51:48 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fb2b52-707f-4c1b-81bc-f969e2723cbe]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:51:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd3289a0-00ce-41ca-8267-59dbb4654159 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:49 devstack quobyte-client[83143]: System call of process 97443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:51:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd3289a0-00ce-41ca-8267-59dbb4654159" returned: 0 in 0.989s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd3289a0-00ce-41ca-8267-59dbb4654159 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd3289a0-00ce-41ca-8267-59dbb4654159" returned: 0 in 0.242s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Lock "cinder-quobyte-fd3289a0-00ce-41ca-8267-59dbb4654159" released by "delete_volume" :: held 1.836s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:51 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-0614538e-fa1d-49f7-b667-eede21cf69f1 req-41d7ea86-b193-4188-a1b4-0fa0e2963083 tempest-TestShelveInstance-488807433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:51 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-0614538e-fa1d-49f7-b667-eede21cf69f1 req-41d7ea86-b193-4188-a1b4-0fa0e2963083 tempest-TestShelveInstance-488807433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:51:51 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-0614538e-fa1d-49f7-b667-eede21cf69f1 req-41d7ea86-b193-4188-a1b4-0fa0e2963083 tempest-TestShelveInstance-488807433 None] Terminate volume connection completed successfully.
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-0614538e-fa1d-49f7-b667-eede21cf69f1 req-41d7ea86-b193-4188-a1b4-0fa0e2963083 tempest-TestShelveInstance-488807433 None] Deleting attachment e162344d-3f38-4f88-bb30-6ca21f6e22af. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Created reservations ['c3d32356-2bbd-4ffe-abb2-98cb90be273c', 'ca0ed842-b193-444e-a0a1-e5bf8ed7b44e', 'f37568b8-7ed0-46ea-896a-ac5132031267', 'f345b2be-f0bd-4410-b340-39b7f31189a0'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.140s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:51 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:51:51 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Deleted volume successfully.
Sep 17 19:51:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3951e2ef-d0e9-4061-a1fd-13a5374f35f7 tempest-VolumesTestJSON-577236283 None] Lock "cinder-fd3289a0-00ce-41ca-8267-59dbb4654159-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.235s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:51:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:52:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:00 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b5d29e-a6b6-444a-8bb6-7859e15f3006]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:52:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 0 in 1.131s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:03 devstack quobyte-client[83143]: System call of process 97469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:52:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 1 in 1.089s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:52:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.685s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbe1b237-0c17-42da-8b39-3c85fb80f6cb', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:52:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:04 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-8b3c6d7a-aeed-46f4-aab8-b5b4fdf42e7d req-8f0e35eb-e045-44da-9ce2-fcd9b12cb924 tempest-TestShelveInstance-488807433 None] attachment_update completed successfully.
Sep 17 19:52:14 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=27,cinder:SELECT=27,cinder:DELETE=5,cinder:INSERT=9 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:52:14 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=23,cinder:UPDATE=37,cinder:DELETE=1,cinder:INSERT=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:52:19 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Flow 'volume_create_manager' (5e61ddd4-fc75-4a08-87ca-952bdbfd89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af80dbc-576c-4ead-ba01-b85aa2ca306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af80dbc-576c-4ead-ba01-b85aa2ca306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1116366419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a86a48-5045-4c2e-bd07-42ff13e9cd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1359cc47136e49359252cfeb7699dabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:52:20Z,use_quota=True,user_id='b6bb3570a6174865b1abcb2f181f59cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95558761-371b-45ba-b433-5e28b7127d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95558761-371b-45ba-b433-5e28b7127d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997919ed-4fe3-41bd-b31c-937003815514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997919ed-4fe3-41bd-b31c-937003815514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a86a48-5045-4c2e-bd07-42ff13e9cd6a', 'volume_name': 'volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1c3827-cb9b-4e84-8b4f-d44050bc3f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1c3827-cb9b-4e84-8b4f-d44050bc3f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aae2191-283a-4ce6-999d-882a084b7480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:19 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Volume 60a86a48-5045-4c2e-bd07-42ff13e9cd6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a', 'volume_size': 1}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1116366419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a86a48-5045-4c2e-bd07-42ff13e9cd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1359cc47136e49359252cfeb7699dabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:52:20Z,use_quota=True,user_id='b6bb3570a6174865b1abcb2f181f59cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Creating volume 60a86a48-5045-4c2e-bd07-42ff13e9cd6a {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:52:19 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:52:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:20 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=87, name=volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:52:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a 1073741824" returned: 0 in 0.725s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a" returned: 0 in 0.162s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] <== create_volume: return (1030ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:52:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aae2191-283a-4ce6-999d-882a084b7480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ab058-c561-4967-afb5-374e19dd3588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:21 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Volume volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a (60a86a48-5045-4c2e-bd07-42ff13e9cd6a): created successfully
Sep 17 19:52:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ab058-c561-4967-afb5-374e19dd3588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Flow 'volume_create_manager' (5e61ddd4-fc75-4a08-87ca-952bdbfd89ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:52:21 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3645d84c-52b6-47be-b415-9a57bbea6ba5 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Created volume successfully.
Sep 17 19:52:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Acquiring lock "cinder-60a86a48-5045-4c2e-bd07-42ff13e9cd6a-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "cinder-60a86a48-5045-4c2e-bd07-42ff13e9cd6a-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:26 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Acquiring lock "cinder-quobyte-60a86a48-5045-4c2e-bd07-42ff13e9cd6a" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "cinder-quobyte-60a86a48-5045-4c2e-bd07-42ff13e9cd6a" acquired by "delete_volume" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:26 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b62f87-9ae5-4dfc-95b6-ce850f8d4978]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:52:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a" returned: 0 in 0.630s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-60a86a48-5045-4c2e-bd07-42ff13e9cd6a" returned: 0 in 0.240s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "cinder-quobyte-60a86a48-5045-4c2e-bd07-42ff13e9cd6a" released by "delete_volume" :: held 1.183s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Created reservations ['1bcb6082-c999-41e9-82d0-b745d77238b6', 'f3d83b56-2b24-4142-91d2-998c17d771ef', 'ec899eae-fda1-4ee1-85e2-ed537bc90862', '486cd3db-13ea-4f26-9ab9-70c802645362'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.158s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:28 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:52:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Deleted volume successfully.
Sep 17 19:52:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-34f08836-88d1-4142-9951-a42609d89995 tempest-VolumeQuotasNegativeTestJSON-1706851556 None] Lock "cinder-60a86a48-5045-4c2e-bd07-42ff13e9cd6a-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:52:35 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Flow 'volume_create_manager' (192b6509-9c5f-453b-9051-a3c9589ca740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c76c8a-b4a8-4f8f-885d-ce67fd4a3b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c76c8a-b4a8-4f8f-885d-ce67fd4a3b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1131040156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db883c97-0b0d-481b-8a95-df4d78f9b1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7fef195c324d13a19caf9c663c220a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:52:36Z,use_quota=True,user_id='b0c4335c73b047d69540758274926508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3211d3a1-590f-47e5-8022-fdc4842a554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3211d3a1-590f-47e5-8022-fdc4842a554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e330ed-dcaa-496e-a4b0-a7f7618da1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e330ed-dcaa-496e-a4b0-a7f7618da1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db883c97-0b0d-481b-8a95-df4d78f9b1a0', 'volume_name': 'volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35918848-ca33-4b8a-94ff-6cf86e74da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35918848-ca33-4b8a-94ff-6cf86e74da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14b79df-ea34-4e7a-ba4d-68b0d7858478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:35 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Volume db883c97-0b0d-481b-8a95-df4d78f9b1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0', 'volume_size': 1}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1131040156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db883c97-0b0d-481b-8a95-df4d78f9b1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7fef195c324d13a19caf9c663c220a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:52:36Z,use_quota=True,user_id='b0c4335c73b047d69540758274926508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Creating volume db883c97-0b0d-481b-8a95-df4d78f9b1a0 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:52:35 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:52:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:36 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=88, name=volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0 1073741824" returned: 0 in 0.425s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0" returned: 0 in 0.173s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] <== create_volume: return (674ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14b79df-ea34-4e7a-ba4d-68b0d7858478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b951e95-2876-44d8-9274-797321fede17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:36 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Volume volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0 (db883c97-0b0d-481b-8a95-df4d78f9b1a0): created successfully
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b951e95-2876-44d8-9274-797321fede17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Flow 'volume_create_manager' (192b6509-9c5f-453b-9051-a3c9589ca740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:52:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e31c5354-3107-4834-9369-1ae513e1f1c3 tempest-VolumesServicesTestJSON-1109569096 None] Created volume successfully.
Sep 17 19:52:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Acquiring lock "cinder-db883c97-0b0d-481b-8a95-df4d78f9b1a0-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Lock "cinder-db883c97-0b0d-481b-8a95-df4d78f9b1a0-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:38 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Acquiring lock "cinder-quobyte-db883c97-0b0d-481b-8a95-df4d78f9b1a0" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Lock "cinder-quobyte-db883c97-0b0d-481b-8a95-df4d78f9b1a0" acquired by "delete_volume" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:38 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a3c623-27d9-4c70-ab78-52611f74dee8]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:52:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0" returned: 0 in 0.564s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-db883c97-0b0d-481b-8a95-df4d78f9b1a0" returned: 0 in 0.132s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Lock "cinder-quobyte-db883c97-0b0d-481b-8a95-df4d78f9b1a0" released by "delete_volume" :: held 0.952s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Created reservations ['1b0a6e49-d856-4b60-bcef-84d5d72a4814', '8b146f01-7545-42e9-bd1c-18b2998d6652', '3b01fc4f-a60b-4988-ae91-72843c99493b', '05c0f129-e160-4dc6-a79b-abf497f8d3bc'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.113s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:40 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:52:40 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Deleted volume successfully.
Sep 17 19:52:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-af0da802-0fde-465d-b8dd-f5ced119dd9b tempest-VolumesServicesTestJSON-1109569096 None] Lock "cinder-db883c97-0b0d-481b-8a95-df4d78f9b1a0-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:52:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Flow 'volume_create_manager' (45d805c9-a5f5-4307-8911-cc0b1660d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a8ebe3-c6c4-46a1-8008-39bc880b6536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a8ebe3-c6c4-46a1-8008-39bc880b6536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-310488552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c8a184-f79a-43d8-a2b8-36637cf758e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d01801ad8041b89035bcf84be69b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:52:47Z,use_quota=True,user_id='86773ae1252f4c16be0dbdee2d1b936d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cc9c9f-68f7-4dcc-8e89-3ae529b6a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cc9c9f-68f7-4dcc-8e89-3ae529b6a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4feab8-9f39-44df-88ef-901cd1e65ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4feab8-9f39-44df-88ef-901cd1e65ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c8a184-f79a-43d8-a2b8-36637cf758e2', 'volume_name': 'volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c16e65-baa8-4de7-a514-069e89eb923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c16e65-baa8-4de7-a514-069e89eb923e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f566809-0f2d-4975-a59f-739e79b49bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:47 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Volume b1c8a184-f79a-43d8-a2b8-36637cf758e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2', 'volume_size': 1}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-310488552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c8a184-f79a-43d8-a2b8-36637cf758e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d01801ad8041b89035bcf84be69b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:52:47Z,use_quota=True,user_id='86773ae1252f4c16be0dbdee2d1b936d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Creating volume b1c8a184-f79a-43d8-a2b8-36637cf758e2 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:52:47 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:52:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:47 devstack quobyte-client[83143]: System call of process 98060 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:52:47 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=89, name=volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:52:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 1073741824" returned: 0 in 0.768s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2" returned: 0 in 0.189s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] <== create_volume: return (1053ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:52:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f566809-0f2d-4975-a59f-739e79b49bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a72dff-0b81-4aab-af00-6c730e023bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:48 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Volume volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 (b1c8a184-f79a-43d8-a2b8-36637cf758e2): created successfully
Sep 17 19:52:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a72dff-0b81-4aab-af00-6c730e023bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Flow 'volume_create_manager' (45d805c9-a5f5-4307-8911-cc0b1660d870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:52:49 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-dc7d0963-810f-4497-979a-95285c6d7dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Created volume successfully.
Sep 17 19:52:49 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Creating offline snapshot a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 of volume b1c8a184-f79a-43d8-a2b8-36637cf758e2 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:52:49 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b8dc9d-5fcf-4f4f-a430-40349bc7b672]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:52:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2" returned: 0 in 0.499s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:50 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=90, name=volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:52:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 1G" returned: 0 in 0.376s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "qemu-img rebase -u -b volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" returned: 0 in 0.331s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" returned: 0 in 0.160s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" returned: 0 in 0.138s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.info" returned: 0 in 0.140s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:52:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.info" returned: 0 in 0.136s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:52 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6ac75c3d-5a4b-46db-9903-e34d24400983 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Create snapshot completed successfully
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "cinder-a63aed20-6dbe-4712-8fff-d8d1bd29bcf2-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-a63aed20-6dbe-4712-8fff-d8d1bd29bcf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "cinder-quobyte-b1c8a184-f79a-43d8-a2b8-36637cf758e2" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-quobyte-b1c8a184-f79a-43d8-a2b8-36637cf758e2" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "cinder-quobyte-a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-quobyte-a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Deleting offline snapshot a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 of volume b1c8a184-f79a-43d8-a2b8-36637cf758e2 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] snapshot_file for this snap is: volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe5a0d2-793b-4ebb-861d-6f9d301f57bb]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:52:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:52:54 devstack quobyte-client[83143]: System call of process 98077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:52:54 devstack quobyte-client[83143]: System call of process 98077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" returned: 0 in 0.880s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.276s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:52:54 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e373ced6-8239-46c5-a76d-0f7012041293]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:52:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2" returned: 0 in 0.820s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:56 devstack quobyte-client[83143]: System call of process 98086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:52:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" returned: 0 in 0.428s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2.a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" returned: 0 in 0.185s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-quobyte-a63aed20-6dbe-4712-8fff-d8d1bd29bcf2" released by "_delete_snapshot" :: held 3.063s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:52:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-quobyte-b1c8a184-f79a-43d8-a2b8-36637cf758e2" released by "delete_snapshot" :: held 3.110s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Created reservations ['2f6a732d-37c9-4774-919f-04d9a19bf2c6', 'b74bc2c4-4527-49b5-bee5-0f8704114ae7', '0023fd92-20be-435f-a6d9-cd8d1e293fc1', 'ad5e4635-b141-4466-bd83-9cf431a69ec6'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:52:57 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Delete snapshot completed successfully.
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c50a5595-fc5e-4ded-95e1-db740f6bf7f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-a63aed20-6dbe-4712-8fff-d8d1bd29bcf2-delete_snapshot" released by "delete_snapshot" :: held 3.578s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:52:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Flow 'volume_create_manager' (1472ceec-ca47-4872-9724-69c7b5e3886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57f2951-b978-44a7-95ef-49fb1a5ee4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57f2951-b978-44a7-95ef-49fb1a5ee4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1488498640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f394ffc-f5b2-48a3-9a5c-2a8478f1b610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4460530bfd36410885a912a1207a0ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:52:58Z,use_quota=True,user_id='56852b1e09ab4305b610e466ececf8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d07128-80c6-4f1a-bbf1-083519c94cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d07128-80c6-4f1a-bbf1-083519c94cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d07dd8-e2fe-4016-b9a9-0cc690a49bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d07dd8-e2fe-4016-b9a9-0cc690a49bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f394ffc-f5b2-48a3-9a5c-2a8478f1b610', 'volume_name': 'volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef18391-e9f7-40da-a5f9-c3b9d51145a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef18391-e9f7-40da-a5f9-c3b9d51145a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9deb3b-bff9-449a-8396-250cbd792465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:57 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Volume 4f394ffc-f5b2-48a3-9a5c-2a8478f1b610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610', 'volume_size': 1}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1488498640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f394ffc-f5b2-48a3-9a5c-2a8478f1b610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4460530bfd36410885a912a1207a0ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:52:58Z,use_quota=True,user_id='56852b1e09ab4305b610e466ececf8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Creating volume 4f394ffc-f5b2-48a3-9a5c-2a8478f1b610 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:52:57 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:52:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:58 devstack quobyte-client[83143]: System call of process 98091 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:52:58 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=92, name=volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "cinder-b1c8a184-f79a-43d8-a2b8-36637cf758e2-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-b1c8a184-f79a-43d8-a2b8-36637cf758e2-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610 1073741824" returned: 0 in 0.587s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610" returned: 0 in 0.273s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] <== create_volume: return (891ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:52:58 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "cinder-quobyte-b1c8a184-f79a-43d8-a2b8-36637cf758e2" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9deb3b-bff9-449a-8396-250cbd792465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0581f9da-78ef-4cfb-b0fa-d28753d50fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:52:58 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Volume volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610 (4f394ffc-f5b2-48a3-9a5c-2a8478f1b610): created successfully
Sep 17 19:52:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0581f9da-78ef-4cfb-b0fa-d28753d50fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:52:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Flow 'volume_create_manager' (1472ceec-ca47-4872-9724-69c7b5e3886c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:52:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-quobyte-b1c8a184-f79a-43d8-a2b8-36637cf758e2" acquired by "delete_volume" :: waited 0.135s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:52:59 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf17bfdc-6b0b-4153-a68f-384f867432d5]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:52:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:59 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-762f4198-5075-4127-9a1b-a669036b39b4 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Created volume successfully.
Sep 17 19:52:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2" returned: 0 in 0.677s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:52:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:52:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b1c8a184-f79a-43d8-a2b8-36637cf758e2" returned: 0 in 0.134s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-quobyte-b1c8a184-f79a-43d8-a2b8-36637cf758e2" released by "delete_volume" :: held 1.053s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Created reservations ['d390acbc-4e08-41f5-982d-daedb4e8a9b3', 'e79a4594-990a-46b4-a1f8-2465d80ba8aa', 'a0b9254d-fb17-4dcc-82ab-b06a87e39ab5', '89e7270d-8456-406f-825a-a996453dcb0e'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.127s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:00 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:53:00 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Deleted volume successfully.
Sep 17 19:53:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ba68b773-9986-47dd-a3d2-b0c5ea0216d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319179815 None] Lock "cinder-b1c8a184-f79a-43d8-a2b8-36637cf758e2-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-df537ecc-e702-431e-a272-bfb1e864ab16 req-9089defd-4b9b-4665-a5e8-5dca0fb14580 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-df537ecc-e702-431e-a272-bfb1e864ab16 req-9089defd-4b9b-4665-a5e8-5dca0fb14580 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:06 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[762d278d-1534-40e7-b7ae-3036344ea5fc]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-df537ecc-e702-431e-a272-bfb1e864ab16 req-9089defd-4b9b-4665-a5e8-5dca0fb14580 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-df537ecc-e702-431e-a272-bfb1e864ab16 req-9089defd-4b9b-4665-a5e8-5dca0fb14580 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610" returned: 0 in 0.854s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-df537ecc-e702-431e-a272-bfb1e864ab16 req-9089defd-4b9b-4665-a5e8-5dca0fb14580 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:07 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-df537ecc-e702-431e-a272-bfb1e864ab16 req-9089defd-4b9b-4665-a5e8-5dca0fb14580 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b595d78d-b6f6-475f-a499-9e2a0d5e4e16', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:53:07 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-df537ecc-e702-431e-a272-bfb1e864ab16 req-9089defd-4b9b-4665-a5e8-5dca0fb14580 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:07 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-df537ecc-e702-431e-a272-bfb1e864ab16 req-9089defd-4b9b-4665-a5e8-5dca0fb14580 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] attachment_update completed successfully.
Sep 17 19:53:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Flow 'volume_create_manager' (233f6ce9-ae0d-467c-8c80-b6a5d3bcf9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918a9bd2-bb36-4c4e-841d-b1ac5f134fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918a9bd2-bb36-4c4e-841d-b1ac5f134fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-148361076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b288a027-1d3c-45fa-bed3-c3cbd83369d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2eb53d35dc24c14b314210d334a2a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:10Z,use_quota=True,user_id='b0d6d84b8bb540bba319b897cc101675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a257d776-fda9-426f-95b7-a587f193a616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a257d776-fda9-426f-95b7-a587f193a616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecca1fb3-16eb-45ed-b0f5-74441f066491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecca1fb3-16eb-45ed-b0f5-74441f066491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b288a027-1d3c-45fa-bed3-c3cbd83369d5', 'volume_name': 'volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c33e81-9225-4ec7-aa4f-fcf54be25294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c33e81-9225-4ec7-aa4f-fcf54be25294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c8d2c3-1a88-43e1-8c58-8784dc651f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:09 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Volume b288a027-1d3c-45fa-bed3-c3cbd83369d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5', 'volume_size': 1}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-148361076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b288a027-1d3c-45fa-bed3-c3cbd83369d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2eb53d35dc24c14b314210d334a2a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:10Z,use_quota=True,user_id='b0d6d84b8bb540bba319b897cc101675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Creating volume b288a027-1d3c-45fa-bed3-c3cbd83369d5 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:53:09 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:53:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:10 devstack quobyte-client[83143]: System call of process 98141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:53:10 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=93, name=volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5 1073741824" returned: 0 in 0.450s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5" returned: 0 in 0.101s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] <== create_volume: return (633ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.648s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c8d2c3-1a88-43e1-8c58-8784dc651f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c25cd9b-0593-4ed5-93c5-d1bfc0cfe1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:10 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Volume volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5 (b288a027-1d3c-45fa-bed3-c3cbd83369d5): created successfully
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c25cd9b-0593-4ed5-93c5-d1bfc0cfe1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Flow 'volume_create_manager' (233f6ce9-ae0d-467c-8c80-b6a5d3bcf9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:10 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-cf20017e-a61e-4a12-946e-4211a6d1d8c2 tempest-VolumesListAdminTestJSON-153334493 None] Created volume successfully.
Sep 17 19:53:13 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:13 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:53:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Flow 'volume_create_manager' (71778c72-5105-48a8-8e26-79cc05ed16d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ad85de-5129-40a3-b40e-ebe57566152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ad85de-5129-40a3-b40e-ebe57566152b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1652872273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e18ed8-8ac7-4223-9b04-5ee7aeca439a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2eb53d35dc24c14b314210d334a2a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:14Z,use_quota=True,user_id='b0d6d84b8bb540bba319b897cc101675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3bc013-1731-413c-a1d1-a8c119a40b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3bc013-1731-413c-a1d1-a8c119a40b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a628ef-a83a-4fd8-b2e8-48aa14c5e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a628ef-a83a-4fd8-b2e8-48aa14c5e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e18ed8-8ac7-4223-9b04-5ee7aeca439a', 'volume_name': 'volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d946eb-81a0-4de2-9a62-c4f0bb6fb5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d946eb-81a0-4de2-9a62-c4f0bb6fb5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ec1a5b-acdd-4a68-9b41-d78a9697c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:14 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Volume d5e18ed8-8ac7-4223-9b04-5ee7aeca439a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a', 'volume_size': 1}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1652872273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e18ed8-8ac7-4223-9b04-5ee7aeca439a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2eb53d35dc24c14b314210d334a2a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:14Z,use_quota=True,user_id='b0d6d84b8bb540bba319b897cc101675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Creating volume d5e18ed8-8ac7-4223-9b04-5ee7aeca439a {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:53:14 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:14 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=94, name=volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a 1073741824" returned: 0 in 0.389s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a" returned: 0 in 0.137s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] <== create_volume: return (600ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.615s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=34,cinder:SELECT=34,cinder:INSERT=14,cinder:DELETE=5 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ec1a5b-acdd-4a68-9b41-d78a9697c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f44af7-64f2-428b-bd34-63674c1356ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=31,cinder:UPDATE=53,cinder:DELETE=4,cinder:INSERT=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:53:14 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Volume volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a (d5e18ed8-8ac7-4223-9b04-5ee7aeca439a): created successfully
Sep 17 19:53:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f44af7-64f2-428b-bd34-63674c1356ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Flow 'volume_create_manager' (71778c72-5105-48a8-8e26-79cc05ed16d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-fd546478-7aef-447c-82f8-b75de7675559 tempest-VolumesListAdminTestJSON-153334493 None] Created volume successfully.
Sep 17 19:53:15 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Flow 'volume_create_manager' (2d741a83-cd2d-4b24-acd9-b7b9c63f69a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178668b8-48d7-45d0-a68f-216d534247ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178668b8-48d7-45d0-a68f-216d534247ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1599341186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6223298-3f9b-4cf7-a8a9-c138f6e0a807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2eb53d35dc24c14b314210d334a2a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:16Z,use_quota=True,user_id='b0d6d84b8bb540bba319b897cc101675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715247d1-c0e1-439e-a339-9215f6aca182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715247d1-c0e1-439e-a339-9215f6aca182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d44e0ff-e285-46da-b612-921f2e70c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d44e0ff-e285-46da-b612-921f2e70c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6223298-3f9b-4cf7-a8a9-c138f6e0a807', 'volume_name': 'volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bf46a9-9c15-4f56-b66c-60e38b2ff78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bf46a9-9c15-4f56-b66c-60e38b2ff78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c96400-bb1e-46b8-b55b-418ae5a2063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Volume d6223298-3f9b-4cf7-a8a9-c138f6e0a807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807', 'volume_size': 1}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1599341186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6223298-3f9b-4cf7-a8a9-c138f6e0a807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2eb53d35dc24c14b314210d334a2a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:16Z,use_quota=True,user_id='b0d6d84b8bb540bba319b897cc101675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Creating volume d6223298-3f9b-4cf7-a8a9-c138f6e0a807 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:53:15 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:53:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:16 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=95, name=volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807 1073741824" returned: 0 in 0.338s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807" returned: 0 in 0.080s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c96400-bb1e-46b8-b55b-418ae5a2063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d413cffb-1b0d-4b05-af54-2b61ab63e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:16 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Volume volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807 (d6223298-3f9b-4cf7-a8a9-c138f6e0a807): created successfully
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d413cffb-1b0d-4b05-af54-2b61ab63e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Flow 'volume_create_manager' (2d741a83-cd2d-4b24-acd9-b7b9c63f69a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d48ad0a1-e7c1-425b-94b3-e0209224d82f tempest-VolumesListAdminTestJSON-153334493 None] Created volume successfully.
Sep 17 19:53:18 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Flow 'volume_create_manager' (289973f0-bc15-4f33-8b12-223780739344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d37ec3-1858-4ed8-bcf7-1298d5af1a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d37ec3-1858-4ed8-bcf7-1298d5af1a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985a06b0-d91f-4aa9-b7fe-cf9190aea270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dab2684be08435db6d30043a3d1be9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:18Z,use_quota=True,user_id='7f478e19fe8f44f4b15233e8a169205d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915f0a1a-28ba-401e-be7d-b55eaf28d68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915f0a1a-28ba-401e-be7d-b55eaf28d68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5263ff56-24b4-4e48-93c6-d4ab9605f8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5263ff56-24b4-4e48-93c6-d4ab9605f8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985a06b0-d91f-4aa9-b7fe-cf9190aea270', 'volume_name': 'volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc3ee7e-8805-4e89-8384-a97e5fd728c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc3ee7e-8805-4e89-8384-a97e5fd728c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602ad41c-2da2-49cf-a864-b3da73ef172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Volume 985a06b0-d91f-4aa9-b7fe-cf9190aea270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270', 'volume_size': 1}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985a06b0-d91f-4aa9-b7fe-cf9190aea270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dab2684be08435db6d30043a3d1be9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:18Z,use_quota=True,user_id='7f478e19fe8f44f4b15233e8a169205d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Creating volume 985a06b0-d91f-4aa9-b7fe-cf9190aea270 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:53:18 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:18 devstack quobyte-client[83143]: System call of process 98158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:53:18 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=96, name=volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270 1073741824" returned: 0 in 0.328s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270" returned: 0 in 0.085s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] <== create_volume: return (479ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:53:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602ad41c-2da2-49cf-a864-b3da73ef172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0e81b6-42a5-49fd-9510-d1ec1dbeb485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:19 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Volume volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270 (985a06b0-d91f-4aa9-b7fe-cf9190aea270): created successfully
Sep 17 19:53:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0e81b6-42a5-49fd-9510-d1ec1dbeb485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Flow 'volume_create_manager' (289973f0-bc15-4f33-8b12-223780739344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-201ca610-065a-4e17-905b-31f2d51058ed tempest-VolumesListAdminTestJSON-823932674 None] Created volume successfully.
Sep 17 19:53:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Acquiring lock "cinder-985a06b0-d91f-4aa9-b7fe-cf9190aea270-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Lock "cinder-985a06b0-d91f-4aa9-b7fe-cf9190aea270-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "cinder-d6223298-3f9b-4cf7-a8a9-c138f6e0a807-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:21 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Acquiring lock "cinder-quobyte-985a06b0-d91f-4aa9-b7fe-cf9190aea270" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Lock "cinder-quobyte-985a06b0-d91f-4aa9-b7fe-cf9190aea270" acquired by "delete_volume" :: waited 0.042s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-d6223298-3f9b-4cf7-a8a9-c138f6e0a807-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[36680c13-a90a-4da8-bdf3-42856dccbbf9]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:21 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "cinder-quobyte-d6223298-3f9b-4cf7-a8a9-c138f6e0a807" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-quobyte-d6223298-3f9b-4cf7-a8a9-c138f6e0a807" acquired by "delete_volume" :: waited 0.074s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4443af7f-f4f4-4e4d-8f1f-eaaec4749a38]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270" returned: 0 in 0.695s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-985a06b0-d91f-4aa9-b7fe-cf9190aea270" returned: 0 in 0.206s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Lock "cinder-quobyte-985a06b0-d91f-4aa9-b7fe-cf9190aea270" released by "delete_volume" :: held 1.228s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807" returned: 0 in 0.972s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d6223298-3f9b-4cf7-a8a9-c138f6e0a807" returned: 0 in 0.420s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-quobyte-d6223298-3f9b-4cf7-a8a9-c138f6e0a807" released by "delete_volume" :: held 1.622s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Created reservations ['131198ec-7ecc-40e0-be36-c2e3023fac49', '1501c6a4-bde5-4302-bca3-b0f33cd7fe27', '62bc27c4-dd4b-4548-924c-137a6d021d11', '35b59699-30c8-449d-83ce-f8886b2a8249'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Created reservations ['a9565c77-8611-4808-95f6-b65dbaac6cc8', 'e3ea76b4-d4f1-4853-879a-bcfee02013a0', '072ee0a4-ea49-4a66-afeb-d7c1f244560d', 'e57131b1-8a78-4915-93f4-74f6b9d78598'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.269s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:23 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:53:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Deleted volume successfully.
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.336s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:53:24 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Deleted volume successfully.
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3aa1ef4f-20b3-4287-8296-e1c93ea407b5 tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-d6223298-3f9b-4cf7-a8a9-c138f6e0a807-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-01f84e40-f23f-45a3-92eb-046af594703d tempest-VolumesListAdminTestJSON-823932674 None] Lock "cinder-985a06b0-d91f-4aa9-b7fe-cf9190aea270-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "cinder-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:24 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "cinder-quobyte-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-quobyte-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a" acquired by "delete_volume" :: waited 0.024s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fa0f26-0832-49f8-a1c8-5cd5aabc7ac0]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a" returned: 0 in 0.481s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a" returned: 0 in 0.104s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-quobyte-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a" released by "delete_volume" :: held 0.758s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:25 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Created reservations ['53edd958-cd14-4a50-bd30-98253e8c83c2', 'eaf2e09c-5099-4f1e-a09a-0ed26a5d2f5b', '08cace14-3cb0-4136-b2a7-4e6c216c8e9a', '20f70856-fa36-4711-89f3-698d046a4b27'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.170s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:53:26 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Deleted volume successfully.
Sep 17 19:53:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8b72049c-ebbe-4f19-b82e-e1195cdee320 tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-d5e18ed8-8ac7-4223-9b04-5ee7aeca439a-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "cinder-b288a027-1d3c-45fa-bed3-c3cbd83369d5-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-b288a027-1d3c-45fa-bed3-c3cbd83369d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:27 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "cinder-quobyte-b288a027-1d3c-45fa-bed3-c3cbd83369d5" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-quobyte-b288a027-1d3c-45fa-bed3-c3cbd83369d5" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:27 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b26fe10-10c9-475b-8da2-27f2e16d4053]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5" returned: 0 in 0.471s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-b288a027-1d3c-45fa-bed3-c3cbd83369d5" returned: 0 in 0.124s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-quobyte-b288a027-1d3c-45fa-bed3-c3cbd83369d5" released by "delete_volume" :: held 0.763s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Created reservations ['9aba4d45-a7a3-4b7f-a401-147e82aef546', '43e12e8e-1bf9-4919-bbb9-b00d1f66dc2b', 'feab8774-795b-42a6-9085-c50978254304', '6a900633-fded-425d-8cce-6542ca77ceac'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.097s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:28 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:53:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Deleted volume successfully.
Sep 17 19:53:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-62fb08d6-2d51-44a0-841a-c9da4dad1edb tempest-VolumesListAdminTestJSON-153334493 None] Lock "cinder-b288a027-1d3c-45fa-bed3-c3cbd83369d5-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:34 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:34 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:53:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Flow 'volume_create_manager' (50a780cf-2ff5-4c81-acf1-e9891da09410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8123b1-8cbe-47ef-8830-0981a00acb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8123b1-8cbe-47ef-8830-0981a00acb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-146824954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a9ad52-3e63-4121-b0cd-52ae351d332c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077a1dc10d3f4d1cacf9f418b7fe154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:35Z,use_quota=True,user_id='af9bc458158b4d3bb09dfe43e4b67ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ee1598-4636-468c-9cdf-dd3e65af11ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ee1598-4636-468c-9cdf-dd3e65af11ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0748c8f-28be-4a34-8784-62589d00da85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:34 devstack cinder-volume[83122]: DEBUG cinder.image.glance [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Creating Keystone auth plugin from conf {{(pid=83122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 19:53:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0748c8f-28be-4a34-8784-62589d00da85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85a9ad52-3e63-4121-b0cd-52ae351d332c', 'volume_name': 'volume-85a9ad52-3e63-4121-b0cd-52ae351d332c', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842cf80070>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88faccb-dd2c-4a73-ab00-9d2eeb8cdd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88faccb-dd2c-4a73-ab00-9d2eeb8cdd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:35 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ba163b-7982-4dd5-99eb-126241932f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:35 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Volume 85a9ad52-3e63-4121-b0cd-52ae351d332c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85a9ad52-3e63-4121-b0cd-52ae351d332c', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842cf80070>}
Sep 17 19:53:35 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Cloning 85a9ad52-3e63-4121-b0cd-52ae351d332c from image 5aeb2b61-d870-4c21-9c73-400584a484f7  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]). {{(pid=83122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 19:53:35 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 19:53:35 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 19:53:35 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[af187ffa-f09e-4b76-9c8d-da090814d647]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:36 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD
Sep 17 19:53:36 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:53:38 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-e6fe4740-e20d-471a-86e9-968313cf9487 req-bf40c4b3-f505-4986-9cce-0820eccc3bb1 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:38 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-e6fe4740-e20d-471a-86e9-968313cf9487 req-bf40c4b3-f505-4986-9cce-0820eccc3bb1 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:38 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-e6fe4740-e20d-471a-86e9-968313cf9487 req-bf40c4b3-f505-4986-9cce-0820eccc3bb1 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Terminate volume connection completed successfully.
Sep 17 19:53:38 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e6fe4740-e20d-471a-86e9-968313cf9487 req-bf40c4b3-f505-4986-9cce-0820eccc3bb1 tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Deleting attachment b595d78d-b6f6-475f-a499-9e2a0d5e4e16. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:53:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Acquiring lock "cinder-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "cinder-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:41 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Acquiring lock "cinder-quobyte-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "cinder-quobyte-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610" acquired by "delete_volume" :: waited 0.087s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:41 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b13d262-3791-42d4-b357-1c654600874d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:42 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Sep 17 19:53:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD" returned: 0 in 6.702s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:42 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Temporary image 5aeb2b61-d870-4c21-9c73-400584a484f7 is fetched for user af9bc458158b4d3bb09dfe43e4b67ce2. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 19:53:42 devstack quobyte-client[83143]: System call of process 98303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:53:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610" returned: 0 in 1.735s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:43 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2fd2e5-9a24-4576-9842-f38e29127e15]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610" returned: 0 in 0.651s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "cinder-quobyte-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610" released by "delete_volume" :: held 2.991s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:44 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD
Sep 17 19:53:44 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Created reservations ['fb25df4b-92e8-4f70-8be2-e18e5e272afa', '9b43d334-4205-475f-ac82-ac00ae6163a9', '8d2c40a9-027f-4447-a00d-ebb82ff61477', '7672e52b-dc2c-4743-94ea-af2685538e01'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.164s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:45 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:53:45 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Deleted volume successfully.
Sep 17 19:53:45 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-125a1dfd-5ead-4ca3-b6dc-c1beaec14cc6 tempest-TestShelveInstance-488807433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88e005a5-f8e8-4f24-8186-3f1b172e5bfb tempest-TestServerVolumeAttachScenarioOldVersion-889011178 None] Lock "cinder-4f394ffc-f5b2-48a3-9a5c-2a8478f1b610-delete_volume" released by "delete_volume" :: held 4.814s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-125a1dfd-5ead-4ca3-b6dc-c1beaec14cc6 tempest-TestShelveInstance-488807433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:46 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-125a1dfd-5ead-4ca3-b6dc-c1beaec14cc6 tempest-TestShelveInstance-488807433 None] Terminate volume connection completed successfully.
Sep 17 19:53:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-125a1dfd-5ead-4ca3-b6dc-c1beaec14cc6 tempest-TestShelveInstance-488807433 None] Deleting attachment bbe1b237-0c17-42da-8b39-3c85fb80f6cb. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:53:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Acquiring lock "cinder-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Lock "cinder-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Acquiring lock "cinder-quobyte-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Lock "cinder-quobyte-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" acquired by "delete_volume" :: waited 0.022s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:47 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5217d8-bbc0-4889-9ea8-f2b5d7936d58]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:48 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD" returned: 0 in 4.158s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-146824954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a9ad52-3e63-4121-b0cd-52ae351d332c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077a1dc10d3f4d1cacf9f418b7fe154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:53:35Z,use_quota=True,user_id='af9bc458158b4d3bb09dfe43e4b67ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Creating volume 85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:48 devstack quobyte-client[83143]: System call of process 98318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:53:48 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:48 devstack quobyte-client[83143]: System call of process 98344 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:53:48 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=97, name=volume-85a9ad52-3e63-4121-b0cd-52ae351d332c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:53:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 0 in 1.796s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c 1073741824" returned: 0 in 0.953s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c" returned: 0 in 0.190s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] <== create_volume: return (1301ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 1 in 0.802s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:53:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" returned: 0 in 0.263s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:50 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Attempting download of 5aeb2b61-d870-4c21-9c73-400584a484f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}])) to volume 85a9ad52-3e63-4121-b0cd-52ae351d332c. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 19:53:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Lock "cinder-quobyte-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8" released by "delete_volume" :: held 3.358s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:50 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bd834f-200f-4a9c-abb3-4eeb13deef98]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_hbbixskq {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_hbbixskq" returned: 0 in 0.623s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_hbbixskq {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_hbbixskq" returned: 1 in 1.130s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aeb2b61-d870-4c21-9c73-400584a484f7_hbbixskq' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:53:52 devstack cinder-volume[83122]: DEBUG cinder.quota [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Created reservations ['126a5e91-a65c-4297-ae5b-322a888bd9f3', '7d4ab738-5d4f-42d9-aa42-a5d52c14a026', '10279ad2-2579-4784-bc51-4ba5e1f700ae', 'a0530c37-2a1b-429a-b2f0-7a41b54aae63'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:53:52 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[060280b2-cc09-4bd5-b1c3-3b16e320f088]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.038s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD" returned: 0 in 1.161s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] 5aeb2b61-d870-4c21-9c73-400584a484f7 was qcow2, converting to raw {{(pid=83122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.329s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:53 devstack cinder-volume[83122]: DEBUG cinder.manager [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:53:53 devstack quobyte-client[83143]: System call of process 98378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:53:53 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=97, name=volume-85a9ad52-3e63-4121-b0cd-52ae351d332c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:53:53 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Deleted volume successfully.
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [req-c9a0f7ea-283a-4cda-98a0-fb9299b1a5dd req-192f0444-c0d2-4bff-9856-ff0a81d4132a tempest-TestShelveInstance-488807433 None] Lock "cinder-8a2a3e0b-3acd-4b22-a23c-a4bd13566cc8-delete_volume" released by "delete_volume" :: held 7.483s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.218s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:53:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c" returned: 0 in 1.589s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:55 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aeb2b61-d870-4c21-9c73-400584a484f7_4nhajq_8devstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:53:55 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Converted 112.00 MB image at 68.82 MB/s
Sep 17 19:53:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c 1G" returned: 0 in 0.337s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:55 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f4154-36ae-4304-b434-b0ef0ae51f7b]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c" returned: 0 in 0.699s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:53:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c" returned: 1 in 0.522s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Downloaded image 5aeb2b61-d870-4c21-9c73-400584a484f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}])) to volume 85a9ad52-3e63-4121-b0cd-52ae351d332c successfully. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Temporary image 5aeb2b61-d870-4c21-9c73-400584a484f7 for user af9bc458158b4d3bb09dfe43e4b67ce2 is deleted. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Marking volume 85a9ad52-3e63-4121-b0cd-52ae351d332c as bootable. {{(pid=83122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Copying metadata from image 5aeb2b61-d870-4c21-9c73-400584a484f7 to 85a9ad52-3e63-4121-b0cd-52ae351d332c. {{(pid=83122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Creating volume glance metadata for volume 85a9ad52-3e63-4121-b0cd-52ae351d332c backed by image 5aeb2b61-d870-4c21-9c73-400584a484f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ba163b-7982-4dd5-99eb-126241932f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a9ad52-3e63-4121-b0cd-52ae351d332c', 'volume_size': 1, 'image_id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aeb2b61-d870-4c21-9c73-400584a484f7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '761c152dff9043c0a4b018a213d85ff7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aeb2b61-d870-4c21-9c73-400584a484f7', 'created_at': datetime.datetime(2025, 9, 17, 17, 15, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aeb2b61-d870-4c21-9c73-400584a484f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842cf80070>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0dfc91-f8eb-4709-a4d5-371764908d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:53:57 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Volume volume-85a9ad52-3e63-4121-b0cd-52ae351d332c (85a9ad52-3e63-4121-b0cd-52ae351d332c): created successfully
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0dfc91-f8eb-4709-a4d5-371764908d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:53:57 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Flow 'volume_create_manager' (50a780cf-2ff5-4c81-acf1-e9891da09410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:53:57 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-da697f23-4b1c-44e4-b633-9a873388ce3d tempest-VolumesImageMetadata-727896297 None] Created volume successfully.
Sep 17 19:53:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Acquiring lock "cinder-85a9ad52-3e63-4121-b0cd-52ae351d332c-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Lock "cinder-85a9ad52-3e63-4121-b0cd-52ae351d332c-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:59 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:53:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Acquiring lock "cinder-quobyte-85a9ad52-3e63-4121-b0cd-52ae351d332c" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:53:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Lock "cinder-quobyte-85a9ad52-3e63-4121-b0cd-52ae351d332c" acquired by "delete_volume" :: waited 0.027s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:53:59 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb98919-a3b8-43d0-92e4-9316d6cc08b3]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:53:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c" returned: 0 in 0.557s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c" returned: 1 in 0.979s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:54:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85a9ad52-3e63-4121-b0cd-52ae351d332c" returned: 0 in 0.334s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Lock "cinder-quobyte-85a9ad52-3e63-4121-b0cd-52ae351d332c" released by "delete_volume" :: held 2.141s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:01 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Created reservations ['ffcae063-5308-46b4-aca0-a5761c2eb8c6', '6428334f-fc23-4674-a7ea-6af2f1a9f9c7', '1adbd23d-5318-4428-b946-22a46174416f', 'a7f34b2b-f123-4f20-bff5-7ba1e2864ffb'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.129s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:02 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:54:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Deleted volume successfully.
Sep 17 19:54:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b076a968-585e-48ae-b379-259dc0317163 tempest-VolumesImageMetadata-727896297 None] Lock "cinder-85a9ad52-3e63-4121-b0cd-52ae351d332c-delete_volume" released by "delete_volume" :: held 3.974s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:11 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Flow 'volume_create_manager' (24a45af6-84ca-48e5-a440-79b8044e4997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43e3094-440c-49b3-911c-4338d35e92e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43e3094-440c-49b3-911c-4338d35e92e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-514900150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c402b07e-f168-492b-bde9-d4bea4e0dc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb98821a0f304af5a6f23f0eed2ad975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:11Z,use_quota=True,user_id='7fc8449ce16a4b34ac6b91b8b739bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e11f1c0-f7b6-44f6-b42f-e6221555add0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e11f1c0-f7b6-44f6-b42f-e6221555add0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9aea81-3273-4bf4-b155-49321372ede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9aea81-3273-4bf4-b155-49321372ede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c402b07e-f168-492b-bde9-d4bea4e0dc22', 'volume_name': 'volume-c402b07e-f168-492b-bde9-d4bea4e0dc22', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b62e8d-0090-453f-944e-7cb3dde1304d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b62e8d-0090-453f-944e-7cb3dde1304d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98a4473-9299-4037-b745-238e978fed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:11 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Volume c402b07e-f168-492b-bde9-d4bea4e0dc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c402b07e-f168-492b-bde9-d4bea4e0dc22', 'volume_size': 1}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-514900150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c402b07e-f168-492b-bde9-d4bea4e0dc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb98821a0f304af5a6f23f0eed2ad975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:11Z,use_quota=True,user_id='7fc8449ce16a4b34ac6b91b8b739bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Creating volume c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:11 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:54:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:12 devstack quobyte-client[83143]: System call of process 98420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:12 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=98, name=volume-c402b07e-f168-492b-bde9-d4bea4e0dc22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 1073741824" returned: 0 in 0.406s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22" returned: 0 in 0.107s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] <== create_volume: return (640ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98a4473-9299-4037-b745-238e978fed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c402b07e-f168-492b-bde9-d4bea4e0dc22', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d26f58-aef3-4983-b008-509c1004091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:12 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Volume volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 (c402b07e-f168-492b-bde9-d4bea4e0dc22): created successfully
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d26f58-aef3-4983-b008-509c1004091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Flow 'volume_create_manager' (24a45af6-84ca-48e5-a440-79b8044e4997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:12 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-52e61667-2bc1-4376-bba7-d340efc03d45 tempest-VolumesDeleteCascade-1107835033 None] Created volume successfully.
Sep 17 19:54:14 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Creating offline snapshot 697d63d2-55c6-4220-a7b7-8892ad782106 of volume c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:54:14 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2510233d-e85c-46dc-aab6-c942926b7094]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22" returned: 0 in 0.672s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:15 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=99, name=volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 1G" returned: 0 in 0.302s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img rebase -u -b volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106" returned: 0 in 0.327s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:54:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=65,cinder:SELECT=53,cinder:INSERT=20,cinder:DELETE=6 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=69,cinder:DELETE=6,cinder:SELECT=49,cinder:INSERT=21 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106" returned: 0 in 1.042s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (e068eb1a-5d28-4082-b267-a0c914e59947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c9ce4b-1a93-4668-b9a1-d5793d96cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c9ce4b-1a93-4668-b9a1-d5793d96cec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452376107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be7d367-ec96-4b99-8f01-4c2189a80742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:16Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41412481-8267-4cd0-a4a9-b9cddf87865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41412481-8267-4cd0-a4a9-b9cddf87865d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8476cfe6-f176-4bad-b5a4-1b1aa8e54479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8476cfe6-f176-4bad-b5a4-1b1aa8e54479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be7d367-ec96-4b99-8f01-4c2189a80742', 'volume_name': 'volume-6be7d367-ec96-4b99-8f01-4c2189a80742', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba76a224-de2e-4a32-ba5a-39136c48be20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba76a224-de2e-4a32-ba5a-39136c48be20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb3abdd-9f13-4f95-9d8d-72547e7e086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Volume 6be7d367-ec96-4b99-8f01-4c2189a80742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be7d367-ec96-4b99-8f01-4c2189a80742', 'volume_size': 1}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106" returned: 0 in 0.877s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:18 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (61725d92-6796-4644-ac39-38566152b749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6938f1-f5c1-4b1d-bd80-17f3aa3fe263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (ffd2d0a3-a7e3-4da9-be46-a87f92487b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd353da-2a2e-41b7-b4b1-3e04a7cf3ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6938f1-f5c1-4b1d-bd80-17f3aa3fe263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2132479212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:17Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd20b43-a878-4109-9ba6-5176b40146ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd20b43-a878-4109-9ba6-5176b40146ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47799322-dd6a-43fb-ad9a-d79f616a82d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47799322-dd6a-43fb-ad9a-d79f616a82d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80', 'volume_name': 'volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef739ae-f77f-400d-af75-34aa2ad873a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef739ae-f77f-400d-af75-34aa2ad873a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd04e40e-ee04-4377-a586-de74c860fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Volume cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80', 'volume_size': 1}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd353da-2a2e-41b7-b4b1-3e04a7cf3ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384859671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:17Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a94fa99-3a9f-4c1c-a833-2a813fabba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a94fa99-3a9f-4c1c-a833-2a813fabba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8947906e-5681-4f60-b86e-f5795071bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8947906e-5681-4f60-b86e-f5795071bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94f0cdd-2c85-4d88-90d4-fa8028cf2bc1', 'volume_name': 'volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0987a15-6d3e-4818-a25b-39107b4e23a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0987a15-6d3e-4818-a25b-39107b4e23a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105981c0-f3df-4f32-8e69-34659da30f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Volume d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1', 'volume_size': 1}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.info" returned: 0 in 0.801s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:54:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:19 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (31c454ab-5759-458a-ac99-4f391d45c105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643972b0-f38a-49d3-ac59-c8ed4b2d8649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (901c23d5-da1f-4c29-a62e-c2dfdedd1028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b784e3d4-f9f5-4977-b5ea-6318e20b28b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b784e3d4-f9f5-4977-b5ea-6318e20b28b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462001123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc62e61-1fbc-453e-b292-5cb6daeca7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:19Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2fe0918-d521-4b1e-8b1c-3942fe5cce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2fe0918-d521-4b1e-8b1c-3942fe5cce5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd0a3fa-3078-4de3-9a06-bdae446119b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd0a3fa-3078-4de3-9a06-bdae446119b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc62e61-1fbc-453e-b292-5cb6daeca7af', 'volume_name': 'volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0e6b24-a3c0-4eeb-89a0-b04bd5e2e20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0e6b24-a3c0-4eeb-89a0-b04bd5e2e20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ab73f5-96f6-458d-8de5-11e347215184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Volume cdc62e61-1fbc-453e-b292-5cb6daeca7af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af', 'volume_size': 1}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.info" returned: 0 in 0.551s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.982s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452376107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be7d367-ec96-4b99-8f01-4c2189a80742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:16Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Creating volume 6be7d367-ec96-4b99-8f01-4c2189a80742 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:19 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6be7d367-ec96-4b99-8f01-4c2189a80742 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:19 devstack quobyte-client[83143]: System call of process 98440 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:19 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=101, name=volume-6be7d367-ec96-4b99-8f01-4c2189a80742, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643972b0-f38a-49d3-ac59-c8ed4b2d8649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-470249987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ec6fa7-5ed2-48f2-9e8e-6b40fd551127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:18Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f864aa-bea2-4cf6-80c5-c32d5741b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f864aa-bea2-4cf6-80c5-c32d5741b21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8c6c11-6143-4f37-89e7-4ec0c8aa1876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8c6c11-6143-4f37-89e7-4ec0c8aa1876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ec6fa7-5ed2-48f2-9e8e-6b40fd551127', 'volume_name': 'volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33560af3-9453-4533-b649-5453b9944bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33560af3-9453-4533-b649-5453b9944bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e47b7d-fbda-4e59-a76c-ef6c8780d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:19 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Volume 34ec6fa7-5ed2-48f2-9e8e-6b40fd551127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127', 'volume_size': 1}
Sep 17 19:54:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-fb1105e5-4a98-46ab-8574-879b74cc3963 tempest-VolumesDeleteCascade-1107835033 None] Create snapshot completed successfully
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6be7d367-ec96-4b99-8f01-4c2189a80742 1073741824" returned: 0 in 0.520s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6be7d367-ec96-4b99-8f01-4c2189a80742 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6be7d367-ec96-4b99-8f01-4c2189a80742" returned: 0 in 0.167s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] <== create_volume: return (730ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2132479212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:17Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Creating volume cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:20 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:20 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=102, name=volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb3abdd-9f13-4f95-9d8d-72547e7e086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be7d367-ec96-4b99-8f01-4c2189a80742', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40ef308-6633-449c-a575-90a07d6101b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:20 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Volume volume-6be7d367-ec96-4b99-8f01-4c2189a80742 (6be7d367-ec96-4b99-8f01-4c2189a80742): created successfully
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40ef308-6633-449c-a575-90a07d6101b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (e068eb1a-5d28-4082-b267-a0c914e59947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80 1073741824" returned: 0 in 0.540s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:21 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8120d1d8-e423-49cf-adc6-075169e36140 tempest-CreateVolumesFromImageTest-1029829819 None] Created volume successfully.
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80" returned: 0 in 0.464s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] <== create_volume: return (1035ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.633s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384859671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:17Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Creating volume d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:21 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:21 devstack quobyte-client[83143]: System call of process 98448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:21 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=103, name=volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd04e40e-ee04-4377-a586-de74c860fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0829ef5-6e05-4644-b86c-3effebfaa022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:21 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1 1073741824" returned: 0 in 0.541s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:22 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Volume volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80 (cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80): created successfully
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0829ef5-6e05-4644-b86c-3effebfaa022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (61725d92-6796-4644-ac39-38566152b749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1" returned: 0 in 0.440s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] <== create_volume: return (1011ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.049s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462001123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc62e61-1fbc-453e-b292-5cb6daeca7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:19Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Creating volume cdc62e61-1fbc-453e-b292-5cb6daeca7af {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:22 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7660b2ca-8978-42a4-83ab-515b16bab77f tempest-CreateVolumesFromImageTest-1029829819 None] Created volume successfully.
Sep 17 19:54:22 devstack quobyte-client[83143]: System call of process 98452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:22 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=104, name=volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105981c0-f3df-4f32-8e69-34659da30f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcb5f2d-1096-43cd-8612-c0993c813fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:22 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Volume volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1 (d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1): created successfully
Sep 17 19:54:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcb5f2d-1096-43cd-8612-c0993c813fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (ffd2d0a3-a7e3-4da9-be46-a87f92487b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af 1073741824" returned: 0 in 0.515s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-04485b8e-7612-4a66-84a4-8cea2d87b4a5 tempest-CreateVolumesFromImageTest-1029829819 None] Created volume successfully.
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af" returned: 0 in 0.411s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] <== create_volume: return (1001ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.559s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-470249987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ec6fa7-5ed2-48f2-9e8e-6b40fd551127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3357f120d5e94adcbfa0bba4003550bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:18Z,use_quota=True,user_id='7c726fc059fa400cbaa1baa23200e4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Creating volume 34ec6fa7-5ed2-48f2-9e8e-6b40fd551127 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:23 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:23 devstack quobyte-client[83143]: System call of process 98456 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:23 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=105, name=volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ab73f5-96f6-458d-8de5-11e347215184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba6263e-f5a3-473e-9d0a-49f4ca2e4e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:24 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Volume volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af (cdc62e61-1fbc-453e-b292-5cb6daeca7af): created successfully
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba6263e-f5a3-473e-9d0a-49f4ca2e4e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (901c23d5-da1f-4c29-a62e-c2dfdedd1028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:24 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-fb55d8e3-44a8-411e-9a88-75019211e87c tempest-CreateVolumesFromImageTest-1029829819 None] Created volume successfully.
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127 1073741824" returned: 0 in 0.723s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127" returned: 0 in 0.129s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] <== create_volume: return (992ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.687s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e47b7d-fbda-4e59-a76c-ef6c8780d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8cda58-afd4-4122-8e02-87f027edcbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Creating offline snapshot 080c14e3-6062-4125-9613-617323a5f258 of volume c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8f277-ce39-4cb6-8dc7-ceb18f662525]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:25 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Volume volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127 (34ec6fa7-5ed2-48f2-9e8e-6b40fd551127): created successfully
Sep 17 19:54:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8cda58-afd4-4122-8e02-87f027edcbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Flow 'volume_create_manager' (31c454ab-5759-458a-ac99-4f391d45c105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:25 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-34031eee-346d-41e9-8fd4-2bfe7ed4f165 tempest-CreateVolumesFromImageTest-1029829819 None] Created volume successfully.
Sep 17 19:54:25 devstack quobyte-client[83143]: System call of process 98461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106" returned: 0 in 0.604s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:25 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c402b07e-f168-492b-bde9-d4bea4e0dc22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:54:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:25 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=106, name=volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 1G" returned: 0 in 0.448s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-cdc62e61-1fbc-453e-b292-5cb6daeca7af-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img rebase -u -b volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258" returned: 0 in 0.437s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-cdc62e61-1fbc-453e-b292-5cb6daeca7af-delete_volume" acquired by "delete_volume" :: waited 0.322s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258" returned: 0 in 0.430s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:54:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258" returned: 0 in 0.419s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.866s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:27 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-quobyte-cdc62e61-1fbc-453e-b292-5cb6daeca7af" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:27 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d53974de-4cbf-40b6-bc0a-8ed7547efd98 tempest-VolumesDeleteCascade-1107835033 None] Create snapshot completed successfully
Sep 17 19:54:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-cdc62e61-1fbc-453e-b292-5cb6daeca7af" acquired by "delete_volume" :: waited 0.100s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:27 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd486cb0-ba4e-4581-8c91-ac5250fcbd67]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:28 devstack quobyte-client[83143]: System call of process 98502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af" returned: 0 in 0.700s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cdc62e61-1fbc-453e-b292-5cb6daeca7af" returned: 0 in 0.244s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-c402b07e-f168-492b-bde9-d4bea4e0dc22-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-cdc62e61-1fbc-453e-b292-5cb6daeca7af" released by "delete_volume" :: held 1.340s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-c402b07e-f168-492b-bde9-d4bea4e0dc22-delete_volume" acquired by "delete_volume" :: waited 0.210s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:29 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Performing cascade delete. {{(pid=83122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Created reservations ['a771a0f5-fd42-42d1-9334-a63670c70a64', '2c98fc3d-f231-4bfd-b719-42fa4880f599', '8ad9c801-9e82-48cc-b382-dbd30b05883d', '35eee71e-4bdf-4585-ad66-ec4648798e04'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-080c14e3-6062-4125-9613-617323a5f258-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-080c14e3-6062-4125-9613-617323a5f258-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:29 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-080c14e3-6062-4125-9613-617323a5f258" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-080c14e3-6062-4125-9613-617323a5f258" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Deleting offline snapshot 080c14e3-6062-4125-9613-617323a5f258 of volume c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] snapshot_file for this snap is: volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe1fa3-a389-4886-b463-3efcca538557]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.321s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:30 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:54:30 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Deleted volume successfully.
Sep 17 19:54:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-00c82b78-63bb-4e59-8259-c5565d0868ee tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-cdc62e61-1fbc-453e-b292-5cb6daeca7af-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258" returned: 0 in 0.773s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c402b07e-f168-492b-bde9-d4bea4e0dc22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:54:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:30 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d586f481-1120-41a6-ad94-c6c2d3b5ee59]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127-delete_volume" acquired by "delete_volume" :: waited 0.290s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-quobyte-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127" acquired by "delete_volume" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:31 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[398b3399-def8-4874-8362-bc44839617ef]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106" returned: 0 in 0.841s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c402b07e-f168-492b-bde9-d4bea4e0dc22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:54:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:31 devstack quobyte-client[83143]: System call of process 98522 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258" returned: 0 in 0.411s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:32 devstack quobyte-client[83143]: System call of process 98519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127" returned: 0 in 0.930s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.080c14e3-6062-4125-9613-617323a5f258" returned: 0 in 0.422s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127" returned: 0 in 0.438s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-080c14e3-6062-4125-9613-617323a5f258" released by "_delete_snapshot" :: held 3.166s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" released by "delete_snapshot" :: held 3.228s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127" released by "delete_volume" :: held 1.611s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Created reservations ['904ed057-be28-4b26-882e-937b4d0668e3', '727b0a59-d570-4c5e-ae79-f480c139f4f2', '7be40f83-6b6c-4ef2-9e58-81894f4cc96b', '943c73c7-cc3e-4d5e-9317-5c5ebc5bf249'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Created reservations ['3021c60f-7f76-47b5-afe8-d2bd56638d73', '5ad05ccc-2d1b-4bce-b8f6-e3f806a22193', '1837ebce-dccf-4d9c-b4ca-8b97609eeb35', '702da699-c561-45e7-83bf-b09f8895bd68'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:33 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Delete snapshot completed successfully.
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-080c14e3-6062-4125-9613-617323a5f258-delete_snapshot" released by "delete_snapshot" :: held 3.881s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-697d63d2-55c6-4220-a7b7-8892ad782106-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-697d63d2-55c6-4220-a7b7-8892ad782106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.424s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:54:34 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Deleted volume successfully.
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" acquired by "delete_snapshot" :: waited 0.225s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-697d63d2-55c6-4220-a7b7-8892ad782106" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-697d63d2-55c6-4220-a7b7-8892ad782106" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Deleting offline snapshot 697d63d2-55c6-4220-a7b7-8892ad782106 of volume c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] snapshot_file for this snap is: volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2cb898-f3a5-48fa-9560-fb5c82c100ab]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0075f386-3b64-4e7f-a1ed-8e8b03d0f90b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-34ec6fa7-5ed2-48f2-9e8e-6b40fd551127-delete_volume" released by "delete_volume" :: held 3.800s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:35 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-quobyte-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106" returned: 0 in 0.945s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c402b07e-f168-492b-bde9-d4bea4e0dc22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e51d6d-72b0-4605-9819-4068ed04be42]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1" acquired by "delete_volume" :: waited 0.031s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aefdf55-2752-4154-a6d1-67909a6162e1]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22" returned: 0 in 0.699s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1" returned: 0 in 1.024s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106" returned: 0 in 0.574s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1" returned: 0 in 0.367s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1" released by "delete_volume" :: held 1.794s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22.697d63d2-55c6-4220-a7b7-8892ad782106" returned: 0 in 0.528s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-697d63d2-55c6-4220-a7b7-8892ad782106" released by "_delete_snapshot" :: held 3.099s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" released by "delete_snapshot" :: held 3.140s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Created reservations ['d90249fa-7cb9-4d1f-bd4b-3dce9fd017ac', '068d9e4f-c2b6-40a3-841c-384a61de04b6', '70ad8452-3ecb-4ec3-b33b-cb53a80776fa', 'b6d89412-01b7-4ead-8550-6687af4bdde7'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Created reservations ['265d8675-59de-4406-912c-777b0b0e3769', 'f871c0fb-87d6-46c7-af6d-c2ab6d6c06d1', 'e41c7542-5c9d-4677-98aa-fa4129f0e433', 'c3b68c69-0fa4-4855-be98-fc6df108cb77'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Delete snapshot completed successfully.
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-697d63d2-55c6-4220-a7b7-8892ad782106-delete_snapshot" released by "delete_snapshot" :: held 4.488s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Snapshots deleted, issuing volume delete {{(pid=83122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.372s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:38 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Deleted volume successfully.
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" acquired by "delete_volume" :: waited 0.352s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6cec04-938e-45bf-a0b4-c95ebe7017c9]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80-delete_volume" acquired by "delete_volume" :: waited 0.397s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c202ae5b-7c75-4072-a4f0-1cf9c8b67205 tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-d94f0cdd-2c85-4d88-90d4-fa8028cf2bc1-delete_volume" released by "delete_volume" :: held 4.044s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:39 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-quobyte-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22" returned: 0 in 0.643s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80" acquired by "delete_volume" :: waited 0.229s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c402b07e-f168-492b-bde9-d4bea4e0dc22" returned: 0 in 0.251s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b84b102-cbb7-4ec0-82a8-06a1ece43416]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-c402b07e-f168-492b-bde9-d4bea4e0dc22" released by "delete_volume" :: held 1.133s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:39 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Created reservations ['1b567e5c-29c5-4de7-9099-04ab67381ccb', '422239c5-10a7-43db-adb5-69e1afe68f5b', '34674548-093b-4bcf-81f0-543af26360fd', '6d162820-aabb-4522-9992-31a103564b60'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80" returned: 0 in 0.642s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80" returned: 0 in 0.502s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.275s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:54:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80" released by "delete_volume" :: held 1.509s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:41 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Deleted volume successfully.
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1d94e70-29a5-436d-9334-d6c492ae8feb tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-c402b07e-f168-492b-bde9-d4bea4e0dc22-delete_volume" released by "delete_volume" :: held 11.886s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Created reservations ['af7aad02-d86f-4ca7-b1b8-8b0393544a5d', '70a2ab32-cb68-466e-83f5-3d102958ae04', '345ff7f8-f4cf-4abf-aa27-b1dbc33301f3', '907f795f-ddd6-4a34-871d-c4664747c2f1'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.396s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:54:41 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Deleted volume successfully.
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-6be7d367-ec96-4b99-8f01-4c2189a80742-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:41 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:41 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Flow 'volume_create_manager' (f02ec12d-df27-4239-bd12-07fdc7c8fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a976dc00-b437-4d5a-abc6-ce2540728b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-6be7d367-ec96-4b99-8f01-4c2189a80742-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a976dc00-b437-4d5a-abc6-ce2540728b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1578707984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9823ba7-6f8a-44eb-b1bf-ad690f384adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb98821a0f304af5a6f23f0eed2ad975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:41Z,use_quota=True,user_id='7fc8449ce16a4b34ac6b91b8b739bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741b4996-6172-428b-adb3-ab601248a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741b4996-6172-428b-adb3-ab601248a3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28d7a17-f292-43dd-ab42-7cb48f2bdc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28d7a17-f292-43dd-ab42-7cb48f2bdc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9823ba7-6f8a-44eb-b1bf-ad690f384adb', 'volume_name': 'volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4313697a-2a78-4e8e-b0a7-221e371b98af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4313697a-2a78-4e8e-b0a7-221e371b98af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6c734e-2a34-41f0-a981-d35fdd6551ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:42 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Volume d9823ba7-6f8a-44eb-b1bf-ad690f384adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb', 'volume_size': 1}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1578707984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9823ba7-6f8a-44eb-b1bf-ad690f384adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb98821a0f304af5a6f23f0eed2ad975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:41Z,use_quota=True,user_id='7fc8449ce16a4b34ac6b91b8b739bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Creating volume d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:42 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:42 devstack quobyte-client[83143]: System call of process 98556 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:42 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=107, name=volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c356a6bc-6129-4447-ad43-ad5e7f17817b tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-cd4e94fd-17db-46ed-ae65-fb6d4b1bfc80-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb 1073741824" returned: 0 in 0.477s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:43 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "cinder-quobyte-6be7d367-ec96-4b99-8f01-4c2189a80742" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" returned: 0 in 0.392s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] <== create_volume: return (885ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-6be7d367-ec96-4b99-8f01-4c2189a80742" acquired by "delete_volume" :: waited 0.139s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0441c6af-2354-450a-bba3-14209d6941c7]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6be7d367-ec96-4b99-8f01-4c2189a80742 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6c734e-2a34-41f0-a981-d35fdd6551ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76415a7-0865-48d8-81c5-d14d8cf5473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:43 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Volume volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb (d9823ba7-6f8a-44eb-b1bf-ad690f384adb): created successfully
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76415a7-0865-48d8-81c5-d14d8cf5473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Flow 'volume_create_manager' (f02ec12d-df27-4239-bd12-07fdc7c8fc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:43 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2f9ef3bf-fee7-4296-ab40-a532ef38e5f7 tempest-VolumesDeleteCascade-1107835033 None] Created volume successfully.
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6be7d367-ec96-4b99-8f01-4c2189a80742" returned: 0 in 0.689s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6be7d367-ec96-4b99-8f01-4c2189a80742 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6be7d367-ec96-4b99-8f01-4c2189a80742" returned: 0 in 0.172s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-quobyte-6be7d367-ec96-4b99-8f01-4c2189a80742" released by "delete_volume" :: held 1.138s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:44 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:44 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Creating offline snapshot 65db8c22-44b8-4d38-b420-b33ca5a07a91 of volume d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:54:44 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc215b-ede1-4786-bbbf-f06a723288f1]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Created reservations ['447de613-8d5d-469e-b68c-e275e78d198e', 'b3e82e60-7a40-4148-bb26-3d736fc1678e', '1e4ba20e-e4de-4dac-bb6d-3c0b81167747', '537b2dde-97e2-44af-9c14-1996f68f9e8f'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" returned: 0 in 0.883s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.405s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:45 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:54:45 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Deleted volume successfully.
Sep 17 19:54:45 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=108, name=volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cb3f02c2-70da-4889-afe5-fc8cb341b4bc tempest-CreateVolumesFromImageTest-1029829819 None] Lock "cinder-6be7d367-ec96-4b99-8f01-4c2189a80742-delete_volume" released by "delete_volume" :: held 4.026s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 1G" returned: 0 in 0.531s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img rebase -u -b volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91" returned: 0 in 0.192s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91" returned: 0 in 0.161s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91" returned: 0 in 0.125s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.info" returned: 0 in 0.147s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:54:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.info" returned: 0 in 0.185s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:47 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1e60908e-666b-4c2c-9509-0f45ce24b2a7 tempest-VolumesDeleteCascade-1107835033 None] Create snapshot completed successfully
Sep 17 19:54:49 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:49 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Flow 'volume_create_manager' (600002fa-8007-4399-b440-0dddac74cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2b44d0-9a2d-44d6-a0f9-aecaa2b6be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2b44d0-9a2d-44d6-a0f9-aecaa2b6be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-937234823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07477ee-717a-4b14-9e2e-130f7edc1173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb98821a0f304af5a6f23f0eed2ad975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=65db8c22-44b8-4d38-b420-b33ca5a07a91,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:50Z,use_quota=True,user_id='7fc8449ce16a4b34ac6b91b8b739bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8a9f8f-4405-41d1-a134-ff4bee8f3554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8a9f8f-4405-41d1-a134-ff4bee8f3554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46535851-9f51-4b51-b9e5-4eba0b5fd171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46535851-9f51-4b51-b9e5-4eba0b5fd171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e07477ee-717a-4b14-9e2e-130f7edc1173', 'volume_name': 'volume-e07477ee-717a-4b14-9e2e-130f7edc1173', 'volume_size': 1, 'snapshot_id': '65db8c22-44b8-4d38-b420-b33ca5a07a91'}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07787133-4055-4654-9e15-00b84640809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07787133-4055-4654-9e15-00b84640809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6490dbbf-febb-44a8-a3fd-3111b703c676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:50 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Volume e07477ee-717a-4b14-9e2e-130f7edc1173: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e07477ee-717a-4b14-9e2e-130f7edc1173', 'volume_size': 1, 'snapshot_id': '65db8c22-44b8-4d38-b420-b33ca5a07a91'}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-65db8c22-44b8-4d38-b420-b33ca5a07a91-e07477ee-717a-4b14-9e2e-130f7edc1173" by "_create_volume_from_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-65db8c22-44b8-4d38-b420-b33ca5a07a91-e07477ee-717a-4b14-9e2e-130f7edc1173" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Creating volume e07477ee-717a-4b14-9e2e-130f7edc1173 from snapshot 65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-e07477ee-717a-4b14-9e2e-130f7edc1173" by "_copy_volume_from_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-e07477ee-717a-4b14-9e2e-130f7edc1173" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] snapshot: 65db8c22-44b8-4d38-b420-b33ca5a07a91, volume: e07477ee-717a-4b14-9e2e-130f7edc1173,  {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[88faaea5-1905-45dc-9fcf-10ff4f42a290]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91" returned: 0 in 0.664s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Creating direct copy from snapshot {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f559082-f29d-4cd8-8477-ee0b43631f53]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" returned: 0 in 0.435s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG cinder.utils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173 not found in is_blk_device check {{(pid=83122) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 19:54:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:52 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=110, name=volume-e07477ee-717a-4b14-9e2e-130f7edc1173, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (7c3ae674-27ea-41cd-af85-dff75567d6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b8407a-0394-4117-a6df-8699eb5bb093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b8407a-0394-4117-a6df-8699eb5bb093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1315210404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cf8cd4-4f86-47d6-87a8-25314f634e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:52Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937055fa-5f4d-4e85-a9f0-69d505ab816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937055fa-5f4d-4e85-a9f0-69d505ab816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74b97eb-beb8-4ddb-9bb2-df92135f143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74b97eb-beb8-4ddb-9bb2-df92135f143f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9cf8cd4-4f86-47d6-87a8-25314f634e04', 'volume_name': 'volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7e45fe-261d-4895-862d-56844a8b9ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7e45fe-261d-4895-862d-56844a8b9ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44194896-cf49-431c-919d-249d33363ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:53 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume c9cf8cd4-4f86-47d6-87a8-25314f634e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04', 'volume_size': 1}
Sep 17 19:54:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:54:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.796s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:54:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173" returned: 0 in 6.004s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af55c64-3282-4d0c-929a-c660f9be9bca]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:54:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:58 devstack quobyte-client[83143]: System call of process 98602 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" returned: 0 in 0.845s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:58 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173 {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:54:58 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Converted 1024.00 MB image at 170.07 MB/s
Sep 17 19:54:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:54:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173" returned: 0 in 0.122s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-e07477ee-717a-4b14-9e2e-130f7edc1173" released by "_copy_volume_from_snapshot" :: held 8.568s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-65db8c22-44b8-4d38-b420-b33ca5a07a91-e07477ee-717a-4b14-9e2e-130f7edc1173" released by "_create_volume_from_snapshot" :: held 8.611s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.647s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.542s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1315210404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cf8cd4-4f86-47d6-87a8-25314f634e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:54:52Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Creating volume c9cf8cd4-4f86-47d6-87a8-25314f634e04 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:54:59 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:54:59 devstack quobyte-client[83143]: System call of process 98606 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:54:59 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=111, name=volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6490dbbf-febb-44a8-a3fd-3111b703c676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07477ee-717a-4b14-9e2e-130f7edc1173', 'volume_size': 1, 'snapshot_id': '65db8c22-44b8-4d38-b420-b33ca5a07a91'}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e264f52c-54a5-4888-92f1-dc25809e800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:54:59 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Volume volume-e07477ee-717a-4b14-9e2e-130f7edc1173 (e07477ee-717a-4b14-9e2e-130f7edc1173): created successfully
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e264f52c-54a5-4888-92f1-dc25809e800b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Flow 'volume_create_manager' (600002fa-8007-4399-b440-0dddac74cc26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 1073741824" returned: 0 in 0.648s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:54:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:00 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-ea28f3d4-56b9-42b2-9696-a508cf2d9016 tempest-VolumesDeleteCascade-1107835033 None] Created volume successfully.
Sep 17 19:55:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04" returned: 0 in 0.617s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:00 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] <== create_volume: return (1395ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-d9823ba7-6f8a-44eb-b1bf-ad690f384adb-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:00 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Flow 'volume_create_manager' (fcf2ce53-fbcd-47dc-b37e-d4ac64f301d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ab1651-fb05-40d9-9237-ad671432dd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ab1651-fb05-40d9-9237-ad671432dd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1577219740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0fde6ca-ded2-47e8-b219-8a1be67daff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610a647f7e2422fa8f0062881abae05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:00Z,use_quota=True,user_id='dacaf1cb0a88463c851d2fc7dbc7db2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4d22c9-4d97-4754-8c8f-e52c48b6b3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4d22c9-4d97-4754-8c8f-e52c48b6b3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751c501b-8dc1-408b-8327-5232ac1a0e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751c501b-8dc1-408b-8327-5232ac1a0e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0fde6ca-ded2-47e8-b219-8a1be67daff0', 'volume_name': 'volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb653400-9d4a-49cd-bbf0-0477b00181b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb653400-9d4a-49cd-bbf0-0477b00181b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44435a20-33e8-49fe-9583-a5c73adec25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:01 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume c0fde6ca-ded2-47e8-b219-8a1be67daff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0', 'volume_size': 1}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1577219740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0fde6ca-ded2-47e8-b219-8a1be67daff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610a647f7e2422fa8f0062881abae05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:00Z,use_quota=True,user_id='dacaf1cb0a88463c851d2fc7dbc7db2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Creating volume c0fde6ca-ded2-47e8-b219-8a1be67daff0 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:01 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:01 devstack quobyte-client[83143]: System call of process 98656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:01 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=112, name=volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:01 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:01 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Flow 'volume_create_manager' (5c9fa998-42df-493e-9942-891492240bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f0d58b-9997-4336-92b9-fba83aa9914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-d9823ba7-6f8a-44eb-b1bf-ad690f384adb-delete_volume" acquired by "delete_volume" :: waited 1.366s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44194896-cf49-431c-919d-249d33363ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b86acaf-c045-4a98-bde5-457a3fabd206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f0d58b-9997-4336-92b9-fba83aa9914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-76789586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9d149d-9cbd-4dc6-9737-387f24aa146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610a647f7e2422fa8f0062881abae05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:00Z,use_quota=True,user_id='dacaf1cb0a88463c851d2fc7dbc7db2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d2e2d5-2d41-4505-a24f-554fc61d3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d2e2d5-2d41-4505-a24f-554fc61d3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e82ef7-629c-4224-9af4-b67a9e0f6a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e82ef7-629c-4224-9af4-b67a9e0f6a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9d149d-9cbd-4dc6-9737-387f24aa146d', 'volume_name': 'volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8975f5-e042-43a0-9f35-736108266326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8975f5-e042-43a0-9f35-736108266326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80637cff-48c3-4a32-bd49-a79f577668d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:02 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume aa9d149d-9cbd-4dc6-9737-387f24aa146d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d', 'volume_size': 1}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0 1073741824" returned: 0 in 1.199s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:02 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Performing cascade delete. {{(pid=83122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:02 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 (c9cf8cd4-4f86-47d6-87a8-25314f634e04): created successfully
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b86acaf-c045-4a98-bde5-457a3fabd206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (7c3ae674-27ea-41cd-af85-dff75567d6c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-65db8c22-44b8-4d38-b420-b33ca5a07a91-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0" returned: 0 in 0.563s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] <== create_volume: return (1807ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-76789586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9d149d-9cbd-4dc6-9737-387f24aa146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610a647f7e2422fa8f0062881abae05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:00Z,use_quota=True,user_id='dacaf1cb0a88463c851d2fc7dbc7db2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Creating volume aa9d149d-9cbd-4dc6-9737-387f24aa146d {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:03 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:03 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=113, name=volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:03 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-5e222118-0aa2-4703-b2d6-ba205c1a95d9 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created volume successfully.
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-65db8c22-44b8-4d38-b420-b33ca5a07a91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.542s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:03 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44435a20-33e8-49fe-9583-a5c73adec25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ec8ca2-87a4-407f-81ec-8132295d180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d 1073741824" returned: 0 in 0.785s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:04 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0 (c0fde6ca-ded2-47e8-b219-8a1be67daff0): created successfully
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ec8ca2-87a4-407f-81ec-8132295d180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Flow 'volume_create_manager' (fcf2ce53-fbcd-47dc-b37e-d4ac64f301d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:04 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-daf51dbf-443f-4f61-93f7-5e408cabdbd0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Created volume successfully.
Sep 17 19:55:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d" returned: 0 in 0.612s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] <== create_volume: return (1423ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" acquired by "delete_snapshot" :: waited 0.109s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-65db8c22-44b8-4d38-b420-b33ca5a07a91" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.032s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Creating offline snapshot 5195dfb6-e4df-438c-9f61-269289ab1100 of volume c9cf8cd4-4f86-47d6-87a8-25314f634e04 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80637cff-48c3-4a32-bd49-a79f577668d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea00cdee-a1a2-43be-84fd-f8b3c40f0c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76441782-ac8f-4d20-a998-fc15ca4e0dc1]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-65db8c22-44b8-4d38-b420-b33ca5a07a91" acquired by "_delete_snapshot" :: waited 0.344s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Deleting offline snapshot 65db8c22-44b8-4d38-b420-b33ca5a07a91 of volume d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:55:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] snapshot_file for this snap is: volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:55:04 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d (aa9d149d-9cbd-4dc6-9737-387f24aa146d): created successfully
Sep 17 19:55:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea00cdee-a1a2-43be-84fd-f8b3c40f0c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:05 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Flow 'volume_create_manager' (5c9fa998-42df-493e-9942-891492240bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:05 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df32df84-9f01-45a2-911b-17b0712ad330]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:05 devstack quobyte-client[83143]: System call of process 98761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:05 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-80ebdd17-a144-427e-a3bd-0d796065607b tempest-TestServerVolumeAttachmentScenario-295576274 None] Created volume successfully.
Sep 17 19:55:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04" returned: 0 in 1.242s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:06 devstack quobyte-client[83143]: System call of process 98764 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:06 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=114, name=volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91" returned: 0 in 1.035s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f4789-00e3-4bed-b492-6dae450a43af]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 1G" returned: 0 in 0.625s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:06 devstack quobyte-client[83143]: System call of process 98774 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img rebase -u -b volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100" returned: 0 in 0.254s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100" returned: 0 in 0.127s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:55:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100" returned: 0 in 0.157s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" returned: 0 in 0.910s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.info" returned: 0 in 0.306s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.info" returned: 0 in 0.154s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91" returned: 0 in 0.349s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.325s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb.65db8c22-44b8-4d38-b420-b33ca5a07a91" returned: 0 in 0.345s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-65db8c22-44b8-4d38-b420-b33ca5a07a91" released by "_delete_snapshot" :: held 3.616s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" released by "delete_snapshot" :: held 3.975s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:08 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-72726bb1-efa4-4b0d-8ced-adc719763017 tempest-CreateVolumesFromSnapshotTest-459872435 None] Create snapshot completed successfully
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Created reservations ['2d009ce2-1d9e-483f-b72f-e79ece84b99f', '1a914417-7e56-46ef-895d-eea5f15b6a43', '9ee1507b-8073-41b9-93bb-3a6d1b4e6b69', 'b7936676-5dda-4588-993d-d1058e502e7e'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:08 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Delete snapshot completed successfully.
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-65db8c22-44b8-4d38-b420-b33ca5a07a91-delete_snapshot" released by "delete_snapshot" :: held 5.282s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Snapshots deleted, issuing volume delete {{(pid=83122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" acquired by "delete_volume" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0e938d-c651-4b0b-be43-bf2954625dc6]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" returned: 0 in 0.442s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" returned: 0 in 0.135s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-d9823ba7-6f8a-44eb-b1bf-ad690f384adb" released by "delete_volume" :: held 0.880s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (d5c21312-b8b2-4ac6-b5d0-d09e5e325d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866e2414-7017-4d09-b765-7881acf57918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Created reservations ['e9249753-2f3d-409d-b08e-1c354c29006f', '8e4a9d1c-5253-4578-85e0-fd2ab9f03362', '5d2ccb4b-bf35-4659-8e71-b9f11081c6af', '0aaf86f2-ac50-4c96-b60a-dc3a97434098'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866e2414-7017-4d09-b765-7881acf57918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1672196004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfda789-2e5c-4db5-96da-e972a057283b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:10Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0917b622-50f1-4326-8e85-c34e4ad4b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0917b622-50f1-4326-8e85-c34e4ad4b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4dd3ad5-53fc-4bc2-b1f9-d31066915f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4dd3ad5-53fc-4bc2-b1f9-d31066915f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfda789-2e5c-4db5-96da-e972a057283b', 'volume_name': 'volume-5bfda789-2e5c-4db5-96da-e972a057283b', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3cfdbf-b9cb-497a-a061-db7c60c14016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3cfdbf-b9cb-497a-a061-db7c60c14016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41127b09-d3d0-4239-90a3-1dc474391f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:10 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume 5bfda789-2e5c-4db5-96da-e972a057283b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfda789-2e5c-4db5-96da-e972a057283b', 'volume_size': 1}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1672196004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfda789-2e5c-4db5-96da-e972a057283b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:10Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Creating volume 5bfda789-2e5c-4db5-96da-e972a057283b {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:10 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5bfda789-2e5c-4db5-96da-e972a057283b 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:10 devstack quobyte-client[83143]: System call of process 98791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:10 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=116, name=volume-5bfda789-2e5c-4db5-96da-e972a057283b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (89d95dd4-4cef-4aed-b3c1-16137dacc193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47ee997-23d6-4502-bc38-7b715d663542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47ee997-23d6-4502-bc38-7b715d663542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972611186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a41506-731d-4907-bc80-65da31dd5456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:10Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdeeaf9-4633-4c7b-a1d4-1ffc74447ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdeeaf9-4633-4c7b-a1d4-1ffc74447ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e54fd04-be76-4db7-aaa8-e004bc409eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e54fd04-be76-4db7-aaa8-e004bc409eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a41506-731d-4907-bc80-65da31dd5456', 'volume_name': 'volume-61a41506-731d-4907-bc80-65da31dd5456', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dee179-c107-4116-a1f2-c43076c7fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dee179-c107-4116-a1f2-c43076c7fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bff2de-55a6-4b5a-8afc-98394de8eda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:11 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume 61a41506-731d-4907-bc80-65da31dd5456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a41506-731d-4907-bc80-65da31dd5456', 'volume_size': 1}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5bfda789-2e5c-4db5-96da-e972a057283b 1073741824" returned: 0 in 0.882s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5bfda789-2e5c-4db5-96da-e972a057283b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:11 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (14e702bc-3dc4-4dd4-a70d-a3b73215e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f17342-1e69-46a6-889f-cbb48c5fa6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-e07477ee-717a-4b14-9e2e-130f7edc1173-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f17342-1e69-46a6-889f-cbb48c5fa6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547059868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb16c8c6-fc99-4e35-bd7b-53ce31a0887b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:11Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8939a6cb-16bd-44c7-bef4-5ca961cdabd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8939a6cb-16bd-44c7-bef4-5ca961cdabd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947cda3a-e6b1-4865-98c5-d24980af42ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947cda3a-e6b1-4865-98c5-d24980af42ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb16c8c6-fc99-4e35-bd7b-53ce31a0887b', 'volume_name': 'volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f8524a-41d5-42ef-ab3d-3428aa186736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f8524a-41d5-42ef-ab3d-3428aa186736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714bf4ae-502a-4eba-ade5-552679e42bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:12 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume fb16c8c6-fc99-4e35-bd7b-53ce31a0887b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b', 'volume_size': 1}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5bfda789-2e5c-4db5-96da-e972a057283b" returned: 0 in 1.205s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (7f2e8efe-1d87-4590-a166-0a47a6adbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d869e05d-5b2f-40ac-b88c-b546d145952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] <== create_volume: return (2176ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972611186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a41506-731d-4907-bc80-65da31dd5456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:10Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Creating volume 61a41506-731d-4907-bc80-65da31dd5456 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:12 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-61a41506-731d-4907-bc80-65da31dd5456 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:12 devstack quobyte-client[83143]: System call of process 98796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.871s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:12 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=117, name=volume-61a41506-731d-4907-bc80-65da31dd5456, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-e07477ee-717a-4b14-9e2e-130f7edc1173-delete_volume" acquired by "delete_volume" :: waited 0.648s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:13 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (4e4a6db4-6f38-4183-9fee-1ac2ab9a9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23d4527-84f0-46a2-806a-49a4a4f041ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Deleted volume successfully.
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d869e05d-5b2f-40ac-b88c-b546d145952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139344122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:12Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d74711b-96e0-4028-8b5c-62c2960a23c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d74711b-96e0-4028-8b5c-62c2960a23c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d69264-1dae-4e13-848a-4a64ed34f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d69264-1dae-4e13-848a-4a64ed34f008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1', 'volume_name': 'volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beca3e3b-d587-4c3d-afac-e5a196d73de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beca3e3b-d587-4c3d-afac-e5a196d73de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6dd77c7-1616-4c6a-af4f-1ec6b68b339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1', 'volume_size': 1}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41127b09-d3d0-4239-90a3-1dc474391f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfda789-2e5c-4db5-96da-e972a057283b', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7053bbf1-543a-4b12-97f3-fabf285dfa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23d4527-84f0-46a2-806a-49a4a4f041ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462043407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ded5726-275f-4bf1-ab37-99dde827c0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:12Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf0cead-3428-4c47-92c2-061e861a166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf0cead-3428-4c47-92c2-061e861a166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ee9169-8d70-4343-9bf5-3e0b795361ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ee9169-8d70-4343-9bf5-3e0b795361ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ded5726-275f-4bf1-ab37-99dde827c0e7', 'volume_name': 'volume-2ded5726-275f-4bf1-ab37-99dde827c0e7', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6c81ff-b954-4250-8567-ee2a475dad2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6c81ff-b954-4250-8567-ee2a475dad2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147f13f5-651c-42dd-ab9f-4f3a667a25b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:13 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume 2ded5726-275f-4bf1-ab37-99dde827c0e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ded5726-275f-4bf1-ab37-99dde827c0e7', 'volume_size': 1}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-61a41506-731d-4907-bc80-65da31dd5456 1073741824" returned: 0 in 0.905s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-61a41506-731d-4907-bc80-65da31dd5456 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:13 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume volume-5bfda789-2e5c-4db5-96da-e972a057283b (5bfda789-2e5c-4db5-96da-e972a057283b): created successfully
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7053bbf1-543a-4b12-97f3-fabf285dfa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (d5c21312-b8b2-4ac6-b5d0-d09e5e325d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-61a41506-731d-4907-bc80-65da31dd5456" returned: 0 in 0.465s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] <== create_volume: return (1390ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:13 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "cinder-quobyte-e07477ee-717a-4b14-9e2e-130f7edc1173" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547059868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb16c8c6-fc99-4e35-bd7b-53ce31a0887b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:11Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Creating volume fb16c8c6-fc99-4e35-bd7b-53ce31a0887b {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:14 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:14 devstack quobyte-client[83143]: System call of process 98801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:14 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-829c2aec-963e-487b-8204-74ef7c7ab5cc tempest-CreateVolumesFromSnapshotTest-459872435 None] Created volume successfully.
Sep 17 19:55:14 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=118, name=volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b29088cb-afb9-4a50-a1b1-775c90d61d76 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-d9823ba7-6f8a-44eb-b1bf-ad690f384adb-delete_volume" released by "delete_volume" :: held 12.419s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bff2de-55a6-4b5a-8afc-98394de8eda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a41506-731d-4907-bc80-65da31dd5456', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739c2f15-1444-462c-a38e-1833dbd37ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-e07477ee-717a-4b14-9e2e-130f7edc1173" acquired by "delete_volume" :: waited 0.829s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b 1073741824" returned: 0 in 0.797s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:14 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[507808f1-195c-413a-99dc-eb75fd60a463]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume volume-61a41506-731d-4907-bc80-65da31dd5456 (61a41506-731d-4907-bc80-65da31dd5456): created successfully
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739c2f15-1444-462c-a38e-1833dbd37ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (89d95dd4-4cef-4aed-b3c1-16137dacc193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b" returned: 0 in 0.966s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] <== create_volume: return (1815ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.513s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139344122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:12Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Creating volume fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:15 devstack quobyte-client[83143]: System call of process 98806 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:15 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:16 devstack quobyte-client[83143]: System call of process 98812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:16 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=119, name=volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:16 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c5107280-70f8-4fc7-a87e-10e2428d8396 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created volume successfully.
Sep 17 19:55:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714bf4ae-502a-4eba-ade5-552679e42bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0ed87a-1202-4b29-b242-775dd6eafd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173" returned: 0 in 1.539s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b (fb16c8c6-fc99-4e35-bd7b-53ce31a0887b): created successfully
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0ed87a-1202-4b29-b242-775dd6eafd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (14e702bc-3dc4-4dd4-a70d-a3b73215e649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1 1073741824" returned: 0 in 1.317s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:17 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-bc35584b-e734-44dd-ba70-bddf9a8c3262 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created volume successfully.
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e07477ee-717a-4b14-9e2e-130f7edc1173" returned: 0 in 1.032s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1" returned: 0 in 0.481s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-quobyte-e07477ee-717a-4b14-9e2e-130f7edc1173" released by "delete_volume" :: held 2.995s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] <== create_volume: return (1958ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.541s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462043407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ded5726-275f-4bf1-ab37-99dde827c0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8bc65dee84828b4329a8b1524588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:12Z,use_quota=True,user_id='f3158d9bfa934a4e8b2b446b33c4f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Creating volume 2ded5726-275f-4bf1-ab37-99dde827c0e7 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:18 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2ded5726-275f-4bf1-ab37-99dde827c0e7 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:18 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=120, name=volume-2ded5726-275f-4bf1-ab37-99dde827c0e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6dd77c7-1616-4c6a-af4f-1ec6b68b339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72989b89-5391-47df-a081-dc215edb7e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=101,cinder:SELECT=74,cinder:DELETE=14,cinder:INSERT=27 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:55:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1 (fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1): created successfully
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72989b89-5391-47df-a081-dc215edb7e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (7f2e8efe-1d87-4590-a166-0a47a6adbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=108,cinder:SELECT=73,cinder:DELETE=10,cinder:INSERT=13 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2ded5726-275f-4bf1-ab37-99dde827c0e7 1073741824" returned: 0 in 0.890s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2ded5726-275f-4bf1-ab37-99dde827c0e7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4e1812d9-6371-4a17-8ae6-23e66444801a tempest-CreateVolumesFromSnapshotTest-459872435 None] Created volume successfully.
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2ded5726-275f-4bf1-ab37-99dde827c0e7" returned: 0 in 0.705s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] <== create_volume: return (1627ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147f13f5-651c-42dd-ab9f-4f3a667a25b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ded5726-275f-4bf1-ab37-99dde827c0e7', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed0ce47-3d1e-46d9-8313-f05f035acda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Created reservations ['aa1bbb60-4a95-40a7-8bbb-754961f3f333', '3ff026fe-a449-49cb-83b8-bb986b3e0fe6', '8efe9a2f-0511-4745-8571-5650add89335', '45a77052-9c62-4449-9608-07622fd426e2'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:19 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume volume-2ded5726-275f-4bf1-ab37-99dde827c0e7 (2ded5726-275f-4bf1-ab37-99dde827c0e7): created successfully
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed0ce47-3d1e-46d9-8313-f05f035acda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Flow 'volume_create_manager' (4e4a6db4-6f38-4183-9fee-1ac2ab9a9141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-758f77aa-7eb3-4ba7-ba6b-49a6332f73f0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created volume successfully.
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.088s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:20 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:20 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Deleted volume successfully.
Sep 17 19:55:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-26588aad-5748-4793-9ad9-34799e8e2ad4 tempest-VolumesDeleteCascade-1107835033 None] Lock "cinder-e07477ee-717a-4b14-9e2e-130f7edc1173-delete_volume" released by "delete_volume" :: held 7.535s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-2ded5726-275f-4bf1-ab37-99dde827c0e7-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-2ded5726-275f-4bf1-ab37-99dde827c0e7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:21 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-quobyte-2ded5726-275f-4bf1-ab37-99dde827c0e7" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-2ded5726-275f-4bf1-ab37-99dde827c0e7" acquired by "delete_volume" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:21 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0dce9-b7a2-4b09-9601-0c94c214b578]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2ded5726-275f-4bf1-ab37-99dde827c0e7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2ded5726-275f-4bf1-ab37-99dde827c0e7" returned: 0 in 0.691s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2ded5726-275f-4bf1-ab37-99dde827c0e7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-2ded5726-275f-4bf1-ab37-99dde827c0e7" returned: 0 in 0.259s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-2ded5726-275f-4bf1-ab37-99dde827c0e7" released by "delete_volume" :: held 1.362s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:22 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created reservations ['fea4eaa4-3e14-4164-b33d-f4782426aece', '41102f02-1817-40cd-ad29-9bc4c7d2c442', '86aed738-17bd-49fe-be44-f958a18cb112', '5ff48489-1db4-4206-a637-180796b71245'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.090s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:23 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Deleted volume successfully.
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0a54b573-50f3-4d25-a27d-3eab3a0b8741 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-2ded5726-275f-4bf1-ab37-99dde827c0e7-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:24 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-quobyte-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1" acquired by "delete_volume" :: waited 0.013s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2371c08-1c77-439e-b828-709c3186ab01]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:24 devstack quobyte-client[83143]: System call of process 98931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1" returned: 0 in 0.497s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1" returned: 0 in 0.108s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1" released by "delete_volume" :: held 0.807s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created reservations ['9c9ed940-ac83-4377-a26b-da7d5a24f3c9', 'd1bdb892-0cbc-4a03-be05-dd5519119c60', 'f514ebd5-7aa4-4e1a-8510-b87d265f87e7', '33d33f1c-6d0c-4c98-ae20-b4fd9d7e0ae6'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.169s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:25 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:25 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Deleted volume successfully.
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ea3e8429-c0b9-4078-a9ed-0feb856c5c28 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-fac0a4f4-c5b7-4da4-86d1-74a4bf8678d1-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:26 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Flow 'volume_create_manager' (04638906-5dc4-4f8d-8b02-8901bc0c618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9afb91-b5c1-4cb8-8be5-2af237b148fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9afb91-b5c1-4cb8-8be5-2af237b148fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1685158372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd60a43-363e-44af-9601-e74ecd37f2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb51a81078c46afb7e533208f7445f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:26Z,use_quota=True,user_id='54022fa53d5f4d03b2afd0a926d23fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3ff8a9-28f8-4ed9-adc3-86cbff706df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3ff8a9-28f8-4ed9-adc3-86cbff706df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cf5ecc-1d9e-4980-b3d0-8cc1884f341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cf5ecc-1d9e-4980-b3d0-8cc1884f341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd60a43-363e-44af-9601-e74ecd37f2a8', 'volume_name': 'volume-afd60a43-363e-44af-9601-e74ecd37f2a8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1eeb058-07b4-4db8-aa32-0cb2e95806ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1eeb058-07b4-4db8-aa32-0cb2e95806ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7fcd60-e9c4-4f2c-8968-804c530906ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:26 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Volume afd60a43-363e-44af-9601-e74ecd37f2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd60a43-363e-44af-9601-e74ecd37f2a8', 'volume_size': 1}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1685158372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd60a43-363e-44af-9601-e74ecd37f2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb51a81078c46afb7e533208f7445f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:26Z,use_quota=True,user_id='54022fa53d5f4d03b2afd0a926d23fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Creating volume afd60a43-363e-44af-9601-e74ecd37f2a8 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:26 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-afd60a43-363e-44af-9601-e74ecd37f2a8 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:26 devstack quobyte-client[83143]: System call of process 98943 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:26 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=121, name=volume-afd60a43-363e-44af-9601-e74ecd37f2a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b-delete_volume" acquired by "delete_volume" :: waited 0.415s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-afd60a43-363e-44af-9601-e74ecd37f2a8 1073741824" returned: 0 in 0.715s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-afd60a43-363e-44af-9601-e74ecd37f2a8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:27 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-quobyte-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-afd60a43-363e-44af-9601-e74ecd37f2a8" returned: 0 in 0.465s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] <== create_volume: return (1201ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b" acquired by "delete_volume" :: waited 0.086s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7fcd60-e9c4-4f2c-8968-804c530906ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd60a43-363e-44af-9601-e74ecd37f2a8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b247d10-a180-49b5-9420-9fbcb97d1b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[50445f19-63fa-480e-a9d1-fa147b8d1b7a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:27 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Volume volume-afd60a43-363e-44af-9601-e74ecd37f2a8 (afd60a43-363e-44af-9601-e74ecd37f2a8): created successfully
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b247d10-a180-49b5-9420-9fbcb97d1b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Flow 'volume_create_manager' (04638906-5dc4-4f8d-8b02-8901bc0c618d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-9b574e9c-0faa-4b28-bfe8-5975f4d06cb8 tempest-VolumesMetadataTest-11673321 None] Created volume successfully.
Sep 17 19:55:28 devstack quobyte-client[83143]: System call of process 98955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b" returned: 0 in 1.158s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b" returned: 0 in 0.324s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b" released by "delete_volume" :: held 2.875s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:31 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created reservations ['b3b1923c-f76d-43df-ab5a-12366a07d152', '28042494-81cc-4196-b979-60ef9700281b', 'fa3094d1-07e1-4392-9616-02fbc645f1cb', '08788448-564d-47f9-a976-13cf61d54302'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.425s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:32 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:32 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Deleted volume successfully.
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-61a41506-731d-4907-bc80-65da31dd5456-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Acquiring lock "cinder-afd60a43-363e-44af-9601-e74ecd37f2a8-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-61a41506-731d-4907-bc80-65da31dd5456-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d69d27c3-f2cc-4a43-ba15-b8e927453d68 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-fb16c8c6-fc99-4e35-bd7b-53ce31a0887b-delete_volume" released by "delete_volume" :: held 6.677s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Lock "cinder-afd60a43-363e-44af-9601-e74ecd37f2a8-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-quobyte-61a41506-731d-4907-bc80-65da31dd5456" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Acquiring lock "cinder-quobyte-afd60a43-363e-44af-9601-e74ecd37f2a8" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Lock "cinder-quobyte-afd60a43-363e-44af-9601-e74ecd37f2a8" acquired by "delete_volume" :: waited 0.027s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-61a41506-731d-4907-bc80-65da31dd5456" acquired by "delete_volume" :: waited 0.057s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[101c3ed0-e9ab-4b82-bd80-7e15b897394f]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e424d07f-36a0-4d7a-9901-8b74e2aef148]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-afd60a43-363e-44af-9601-e74ecd37f2a8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-61a41506-731d-4907-bc80-65da31dd5456 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:34 devstack quobyte-client[83143]: System call of process 99053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-afd60a43-363e-44af-9601-e74ecd37f2a8" returned: 0 in 0.885s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-afd60a43-363e-44af-9601-e74ecd37f2a8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-afd60a43-363e-44af-9601-e74ecd37f2a8" returned: 0 in 0.408s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Lock "cinder-quobyte-afd60a43-363e-44af-9601-e74ecd37f2a8" released by "delete_volume" :: held 1.538s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-61a41506-731d-4907-bc80-65da31dd5456" returned: 0 in 1.753s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-61a41506-731d-4907-bc80-65da31dd5456 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-61a41506-731d-4907-bc80-65da31dd5456" returned: 0 in 0.347s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-61a41506-731d-4907-bc80-65da31dd5456" released by "delete_volume" :: held 2.336s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:35 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Created reservations ['052bcc5b-8622-4dee-b144-4391246755df', 'e1c1f733-b821-46d8-bd31-415a802059d2', 'f6f26b34-bde3-401d-8d80-dd04deff2855', '4718d026-651f-4e8f-8576-dfdda001347d'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created reservations ['0508136f-3c57-44d9-a994-792912f3c330', '13060c9b-cc6d-40ab-93df-b9ac68560a16', 'e5f9ca68-e826-4a20-a738-0ce76ae10bcf', 'c0502063-883e-4c3e-9a0e-2864565e040f'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.500s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Deleted volume successfully.
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-254cea0d-d2ac-4786-9901-4a57fc133290 tempest-VolumesMetadataTest-11673321 None] Lock "cinder-afd60a43-363e-44af-9601-e74ecd37f2a8-delete_volume" released by "delete_volume" :: held 3.502s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.138s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:37 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Deleted volume successfully.
Sep 17 19:55:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-5bfda789-2e5c-4db5-96da-e972a057283b-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24c5c8d6-3e60-4663-8eac-f558b96752b0 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-61a41506-731d-4907-bc80-65da31dd5456-delete_volume" released by "delete_volume" :: held 4.826s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-5bfda789-2e5c-4db5-96da-e972a057283b-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:38 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-quobyte-5bfda789-2e5c-4db5-96da-e972a057283b" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-5bfda789-2e5c-4db5-96da-e972a057283b" acquired by "delete_volume" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:38 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f66203-523a-4d67-a868-7b0594b698f1]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5bfda789-2e5c-4db5-96da-e972a057283b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5bfda789-2e5c-4db5-96da-e972a057283b" returned: 0 in 0.527s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5bfda789-2e5c-4db5-96da-e972a057283b {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5bfda789-2e5c-4db5-96da-e972a057283b" returned: 0 in 0.145s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-5bfda789-2e5c-4db5-96da-e972a057283b" released by "delete_volume" :: held 0.989s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:39 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created reservations ['8f6ee68c-8ed4-4097-b487-c03f3c799add', 'a7db0270-8b67-46d1-b129-ee7f0464b92f', '62e5fba5-0d20-40ff-aea6-b629d86c83a4', '87cf08e3-21e3-4d5c-92ab-6e8ae698e0ab'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-5195dfb6-e4df-438c-9f61-269289ab1100-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.770s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-5195dfb6-e4df-438c-9f61-269289ab1100-delete_snapshot" acquired by "delete_snapshot" :: waited 0.293s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:40 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-quobyte-c9cf8cd4-4f86-47d6-87a8-25314f634e04" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:40 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Deleted volume successfully.
Sep 17 19:55:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-c9cf8cd4-4f86-47d6-87a8-25314f634e04" acquired by "delete_snapshot" :: waited 0.181s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-quobyte-5195dfb6-e4df-438c-9f61-269289ab1100" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-5195dfb6-e4df-438c-9f61-269289ab1100" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Deleting offline snapshot 5195dfb6-e4df-438c-9f61-269289ab1100 of volume c9cf8cd4-4f86-47d6-87a8-25314f634e04 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:55:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] snapshot_file for this snap is: volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:55:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-439374bf-ced1-4da4-b032-6612ffd6dcc4 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-5bfda789-2e5c-4db5-96da-e972a057283b-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:41 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2c4fb-a9e9-4adb-bf23-080a1b80c422]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100" returned: 0 in 0.998s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:42 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:55:42 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee46b18-2d2a-44b4-94ea-e977c6e25a6f]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04" returned: 0 in 0.895s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:43 devstack quobyte-client[83143]: System call of process 99086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100" returned: 0 in 0.485s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04.5195dfb6-e4df-438c-9f61-269289ab1100" returned: 0 in 0.215s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-5195dfb6-e4df-438c-9f61-269289ab1100" released by "_delete_snapshot" :: held 3.671s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-c9cf8cd4-4f86-47d6-87a8-25314f634e04" released by "delete_snapshot" :: held 3.722s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:44 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:44 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Flow 'volume_create_manager' (8a860937-2261-4de0-a356-11a00735bcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7447741-1a42-43ae-8d58-8e348014113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7447741-1a42-43ae-8d58-8e348014113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1840953685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaa1eee-e4b4-47f2-9688-3d09e9bb910e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdc2f43a3b84204b639755449408891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:44Z,use_quota=True,user_id='ee745edea88f47a29841e93cb360bf86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7f9a6c-6d5c-4de2-8571-c404573f17e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7f9a6c-6d5c-4de2-8571-c404573f17e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bb32ca-860e-47fd-9569-17808c783b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bb32ca-860e-47fd-9569-17808c783b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baaa1eee-e4b4-47f2-9688-3d09e9bb910e', 'volume_name': 'volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4cfc8e-3190-4f18-9b8d-08258d6e74ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4cfc8e-3190-4f18-9b8d-08258d6e74ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfe30e2-9141-496c-bd91-9cfe384fc058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:45 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Volume baaa1eee-e4b4-47f2-9688-3d09e9bb910e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e', 'volume_size': 1}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1840953685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaa1eee-e4b4-47f2-9688-3d09e9bb910e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdc2f43a3b84204b639755449408891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:44Z,use_quota=True,user_id='ee745edea88f47a29841e93cb360bf86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Creating volume baaa1eee-e4b4-47f2-9688-3d09e9bb910e {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:45 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:45 devstack quobyte-client[83143]: System call of process 99091 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:45 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=122, name=volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e 1073741824" returned: 0 in 0.514s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Created reservations ['84c5c3da-87a4-42c1-85ef-64c6b87d7bbe', '9df2cbf7-90f3-470c-9e2c-52badecb3366', '2445478f-57a5-48be-a996-48abf299aa0e', '8a585997-6935-47dd-8f58-524fe82bb9af'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e" returned: 0 in 0.329s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:46 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] <== create_volume: return (879ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfe30e2-9141-496c-bd91-9cfe384fc058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b434e7-6d8a-451f-9213-2b07c02dbac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:46 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Delete snapshot completed successfully.
Sep 17 19:55:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-dca1aafb-f5fe-4cca-8b2e-8230f1f09caf tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-5195dfb6-e4df-438c-9f61-269289ab1100-delete_snapshot" released by "delete_snapshot" :: held 5.334s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:46 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Volume volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e (baaa1eee-e4b4-47f2-9688-3d09e9bb910e): created successfully
Sep 17 19:55:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b434e7-6d8a-451f-9213-2b07c02dbac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:46 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Flow 'volume_create_manager' (8a860937-2261-4de0-a356-11a00735bcdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:46 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b27a96be-26b5-4a3f-8459-9d55fb9e31b6 tempest-VolumesTransfersV355Test-1233722952 None] Created volume successfully.
Sep 17 19:55:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-c9cf8cd4-4f86-47d6-87a8-25314f634e04-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-c9cf8cd4-4f86-47d6-87a8-25314f634e04-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:47 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "cinder-quobyte-c9cf8cd4-4f86-47d6-87a8-25314f634e04" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-c9cf8cd4-4f86-47d6-87a8-25314f634e04" acquired by "delete_volume" :: waited 0.013s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d2880-eb3d-493d-a24f-b53745e88c86]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04" returned: 0 in 0.502s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c9cf8cd4-4f86-47d6-87a8-25314f634e04" returned: 0 in 0.135s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:47 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-quobyte-c9cf8cd4-4f86-47d6-87a8-25314f634e04" released by "delete_volume" :: held 0.851s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:48 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3e00f08c-eae4-4a81-9be3-f0963d3f90e4 tempest-VolumesTransfersV355Test-235973089 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:48 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3e00f08c-eae4-4a81-9be3-f0963d3f90e4 tempest-VolumesTransfersV355Test-235973089 None] Transfer volume completed successfully.
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Created reservations ['3527662d-91e9-48cf-98fa-c8bbb265c785', 'bfa6b40a-253e-44eb-b987-33ed2275b896', '7310b91f-9dfb-42be-86d3-6f703e88c8c9', 'be8ed04c-f7ff-4b4b-8af5-b87c8256f582'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.263s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:48 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:48 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Deleted volume successfully.
Sep 17 19:55:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3a70aad3-86de-44c7-b420-1abd00bc4f70 tempest-CreateVolumesFromSnapshotTest-459872435 None] Lock "cinder-c9cf8cd4-4f86-47d6-87a8-25314f634e04-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Acquiring lock "cinder-baaa1eee-e4b4-47f2-9688-3d09e9bb910e-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Lock "cinder-baaa1eee-e4b4-47f2-9688-3d09e9bb910e-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:49 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Acquiring lock "cinder-quobyte-baaa1eee-e4b4-47f2-9688-3d09e9bb910e" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Lock "cinder-quobyte-baaa1eee-e4b4-47f2-9688-3d09e9bb910e" acquired by "delete_volume" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:49 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a59d5d-afda-4bca-aada-de543dfb5ec0]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e" returned: 0 in 0.658s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-baaa1eee-e4b4-47f2-9688-3d09e9bb910e" returned: 0 in 0.154s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Lock "cinder-quobyte-baaa1eee-e4b4-47f2-9688-3d09e9bb910e" released by "delete_volume" :: held 1.056s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Created reservations ['e24a80f6-4e93-4129-b276-4338590452a6', '04b8f36f-0c46-41eb-8d52-2882cabdb689', '42b6267d-e806-4a7d-b35b-18dbb1772323', '4e015291-7e04-49b5-b0aa-1952e08774f4'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.152s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:51 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:51 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Deleted volume successfully.
Sep 17 19:55:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-10f50a69-663e-4468-b664-201067be0c3f tempest-VolumesTransfersV355Test-2139510129 None] Lock "cinder-baaa1eee-e4b4-47f2-9688-3d09e9bb910e-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Flow 'volume_create_manager' (46cccf50-0b7d-4d7f-b227-4238fda657d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d745698-2746-46c0-b5ac-772aacd77fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d745698-2746-46c0-b5ac-772aacd77fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-48609809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44db3b59-681e-453c-8bca-11c54200fa37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdc2f43a3b84204b639755449408891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:53Z,use_quota=True,user_id='ee745edea88f47a29841e93cb360bf86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7fe067-49b8-49a5-a4a4-8b214207f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7fe067-49b8-49a5-a4a4-8b214207f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011deaac-c52b-4213-af4e-2c157e5040cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011deaac-c52b-4213-af4e-2c157e5040cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44db3b59-681e-453c-8bca-11c54200fa37', 'volume_name': 'volume-44db3b59-681e-453c-8bca-11c54200fa37', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d5999f-783b-4093-9b43-ebe1ec73d69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d5999f-783b-4093-9b43-ebe1ec73d69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9041100e-7b56-401d-82c6-de9b7806bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:53 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Volume 44db3b59-681e-453c-8bca-11c54200fa37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44db3b59-681e-453c-8bca-11c54200fa37', 'volume_size': 1}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-48609809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44db3b59-681e-453c-8bca-11c54200fa37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdc2f43a3b84204b639755449408891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:53Z,use_quota=True,user_id='ee745edea88f47a29841e93cb360bf86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Creating volume 44db3b59-681e-453c-8bca-11c54200fa37 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:53 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-44db3b59-681e-453c-8bca-11c54200fa37 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:53 devstack quobyte-client[83143]: System call of process 99105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:53 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=123, name=volume-44db3b59-681e-453c-8bca-11c54200fa37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-44db3b59-681e-453c-8bca-11c54200fa37 1073741824" returned: 0 in 0.427s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-44db3b59-681e-453c-8bca-11c54200fa37 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-44db3b59-681e-453c-8bca-11c54200fa37" returned: 0 in 0.172s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] <== create_volume: return (716ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9041100e-7b56-401d-82c6-de9b7806bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44db3b59-681e-453c-8bca-11c54200fa37', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ac6921-09a5-4978-8087-73ee9231f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:54 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Volume volume-44db3b59-681e-453c-8bca-11c54200fa37 (44db3b59-681e-453c-8bca-11c54200fa37): created successfully
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ac6921-09a5-4978-8087-73ee9231f831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Flow 'volume_create_manager' (46cccf50-0b7d-4d7f-b227-4238fda657d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b7625169-b799-4098-bd7d-f257ba2a9699 tempest-VolumesTransfersV355Test-1233722952 None] Created volume successfully.
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.636s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Flow 'volume_create_manager' (b9e9bae7-2c1a-4bda-bd61-d0d48e2784e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9424a359-f97b-46f2-a4c0-91a3d3e939d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9424a359-f97b-46f2-a4c0-91a3d3e939d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5456f0-aa90-466f-9437-95cd6adb87b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ce77b5154b4fbca2cc2c8d8a7b2488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:55Z,use_quota=True,user_id='c9adf2755513451592eba4117cb55bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f351fa2-f3e6-4222-9e53-22c0d71a39ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f351fa2-f3e6-4222-9e53-22c0d71a39ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b04e6b-ff41-4a96-98ba-98081385687b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b04e6b-ff41-4a96-98ba-98081385687b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5456f0-aa90-466f-9437-95cd6adb87b1', 'volume_name': 'volume-5e5456f0-aa90-466f-9437-95cd6adb87b1', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9678986-fa65-46fa-87aa-8d78f0915712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9678986-fa65-46fa-87aa-8d78f0915712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a4c574-6d71-4b50-984d-1e4bfd54b0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:55 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Volume 5e5456f0-aa90-466f-9437-95cd6adb87b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5456f0-aa90-466f-9437-95cd6adb87b1', 'volume_size': 1}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5456f0-aa90-466f-9437-95cd6adb87b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ce77b5154b4fbca2cc2c8d8a7b2488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:55Z,use_quota=True,user_id='c9adf2755513451592eba4117cb55bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Creating volume 5e5456f0-aa90-466f-9437-95cd6adb87b1 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:55 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5e5456f0-aa90-466f-9437-95cd6adb87b1 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:55 devstack quobyte-client[83143]: System call of process 99111 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:55:55 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=124, name=volume-5e5456f0-aa90-466f-9437-95cd6adb87b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5e5456f0-aa90-466f-9437-95cd6adb87b1 1073741824" returned: 0 in 0.465s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5e5456f0-aa90-466f-9437-95cd6adb87b1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Acquiring lock "cinder-44db3b59-681e-453c-8bca-11c54200fa37-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5e5456f0-aa90-466f-9437-95cd6adb87b1" returned: 0 in 0.342s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] <== create_volume: return (897ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Lock "cinder-44db3b59-681e-453c-8bca-11c54200fa37-delete_volume" acquired by "delete_volume" :: waited 0.194s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a4c574-6d71-4b50-984d-1e4bfd54b0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5456f0-aa90-466f-9437-95cd6adb87b1', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ca3b30-3561-4ae9-88bd-b1ad59967863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:56 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Volume volume-5e5456f0-aa90-466f-9437-95cd6adb87b1 (5e5456f0-aa90-466f-9437-95cd6adb87b1): created successfully
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ca3b30-3561-4ae9-88bd-b1ad59967863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Flow 'volume_create_manager' (b9e9bae7-2c1a-4bda-bd61-d0d48e2784e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:56 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Acquiring lock "cinder-quobyte-44db3b59-681e-453c-8bca-11c54200fa37" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:55:56 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-18a8e8a9-629e-4aa5-866e-7022b36ac17e tempest-CinderUnicodeTest-840345384 None] Created volume successfully.
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Lock "cinder-quobyte-44db3b59-681e-453c-8bca-11c54200fa37" acquired by "delete_volume" :: waited 0.034s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c264420-2afe-477a-bfa4-61b7281c8cb4]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:55:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-44db3b59-681e-453c-8bca-11c54200fa37 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-44db3b59-681e-453c-8bca-11c54200fa37" returned: 0 in 0.889s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-44db3b59-681e-453c-8bca-11c54200fa37 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-44db3b59-681e-453c-8bca-11c54200fa37" returned: 0 in 0.496s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Lock "cinder-quobyte-44db3b59-681e-453c-8bca-11c54200fa37" released by "delete_volume" :: held 1.571s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:58 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Flow 'volume_create_manager' (c2473b05-aa7d-49c9-8e1f-6c2c0f0e3cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b89d7e8-05b4-47e5-9b7f-983fcc59199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b89d7e8-05b4-47e5-9b7f-983fcc59199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1957248181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667470a8-ad34-4695-afa7-f632f316987d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ce77b5154b4fbca2cc2c8d8a7b2488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:58Z,use_quota=True,user_id='c9adf2755513451592eba4117cb55bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49fcdc0-50d3-4e52-9e18-84a1cae5593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49fcdc0-50d3-4e52-9e18-84a1cae5593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e539d614-e551-4f9c-acd9-63b49c053bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e539d614-e551-4f9c-acd9-63b49c053bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667470a8-ad34-4695-afa7-f632f316987d', 'volume_name': 'volume-667470a8-ad34-4695-afa7-f632f316987d', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b76095-e65f-4614-9a08-5d4fb0db51bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b76095-e65f-4614-9a08-5d4fb0db51bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eeff3c4-9f9e-4b13-8c49-342b6743acac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:55:58 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Volume 667470a8-ad34-4695-afa7-f632f316987d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667470a8-ad34-4695-afa7-f632f316987d', 'volume_size': 1}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:55:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1957248181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667470a8-ad34-4695-afa7-f632f316987d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ce77b5154b4fbca2cc2c8d8a7b2488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:55:58Z,use_quota=True,user_id='c9adf2755513451592eba4117cb55bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Creating volume 667470a8-ad34-4695-afa7-f632f316987d {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:55:58 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:55:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:59 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=125, name=volume-667470a8-ad34-4695-afa7-f632f316987d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Created reservations ['d6bb2451-e9c9-4886-893a-28fa6d4e26d5', 'b5547b1a-2ff5-48cf-a04f-76f21f517e90', '91c96a31-f396-437e-abf6-118d0ba32207', '992006fd-4a5c-4049-bf0f-b0977f3cde0d'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d 1073741824" returned: 0 in 0.714s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.195s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:55:59 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Deleted volume successfully.
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d" returned: 0 in 0.333s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] <== create_volume: return (1102ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4275360-aaeb-429d-9321-486314e2682e tempest-VolumesTransfersV355Test-2139510129 None] Lock "cinder-44db3b59-681e-453c-8bca-11c54200fa37-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eeff3c4-9f9e-4b13-8c49-342b6743acac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667470a8-ad34-4695-afa7-f632f316987d', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:55:59 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dce9886-5403-44f9-aec5-5507b528df5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:00 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Volume volume-667470a8-ad34-4695-afa7-f632f316987d (667470a8-ad34-4695-afa7-f632f316987d): created successfully
Sep 17 19:56:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dce9886-5403-44f9-aec5-5507b528df5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:00 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Flow 'volume_create_manager' (c2473b05-aa7d-49c9-8e1f-6c2c0f0e3cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:00 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b7ad5bf3-0264-4a06-9a2b-c72c147b3133 tempest-CinderUnicodeTest-840345384 None] Created volume successfully.
Sep 17 19:56:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Creating offline snapshot 6bfa6d48-0d04-4465-83a3-a9c194329890 of volume 667470a8-ad34-4695-afa7-f632f316987d {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 19:56:01 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ebbf7-7b00-4aeb-9180-f9f2931e3996]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d" returned: 0 in 0.553s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:01 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=126, name=volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 1G" returned: 0 in 0.345s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): qemu-img rebase -u -b volume-667470a8-ad34-4695-afa7-f632f316987d -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] CMD "qemu-img rebase -u -b volume-667470a8-ad34-4695-afa7-f632f316987d -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890" returned: 0 in 0.217s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890" returned: 0 in 0.126s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890" returned: 0 in 0.145s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.info" returned: 0 in 0.163s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:03 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 19:56:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.info" returned: 0 in 0.147s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:03 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-fd522b69-bf90-4ae4-95dc-956cae046311 tempest-CinderUnicodeTest-840345384 None] Create snapshot completed successfully
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "cinder-6bfa6d48-0d04-4465-83a3-a9c194329890-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-6bfa6d48-0d04-4465-83a3-a9c194329890-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:04 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "cinder-quobyte-667470a8-ad34-4695-afa7-f632f316987d" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-quobyte-667470a8-ad34-4695-afa7-f632f316987d" acquired by "delete_snapshot" :: waited 0.061s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "cinder-quobyte-6bfa6d48-0d04-4465-83a3-a9c194329890" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-quobyte-6bfa6d48-0d04-4465-83a3-a9c194329890" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Deleting offline snapshot 6bfa6d48-0d04-4465-83a3-a9c194329890 of volume 667470a8-ad34-4695-afa7-f632f316987d {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] snapshot_file for this snap is: volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca3f6dd-6c1f-475a-91dd-d4ad66c95e6c]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890" returned: 0 in 0.632s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:05 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667470a8-ad34-4695-afa7-f632f316987d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 19:56:05 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0142638f-8a0d-4380-bc0c-e389c9b31159]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:05 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d" returned: 0 in 0.606s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:06 devstack quobyte-client[83143]: System call of process 99148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:56:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890" returned: 0 in 0.309s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d.6bfa6d48-0d04-4465-83a3-a9c194329890" returned: 0 in 0.166s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-quobyte-6bfa6d48-0d04-4465-83a3-a9c194329890" released by "_delete_snapshot" :: held 2.107s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:06 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-quobyte-667470a8-ad34-4695-afa7-f632f316987d" released by "delete_snapshot" :: held 2.149s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:07 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Created reservations ['6588a9d8-c192-48af-b1f8-0164bf14c564', 'f75e9bac-b2b2-4e1a-bdd5-ba7a262c9cda', '04eb54da-151b-472a-8e48-2c6f966b4457', 'a6d39efe-5194-49d2-867c-781c7cf443c6'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:56:07 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Delete snapshot completed successfully.
Sep 17 19:56:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b50f087a-9a48-4712-8eb8-e91cd9a72940 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-6bfa6d48-0d04-4465-83a3-a9c194329890-delete_snapshot" released by "delete_snapshot" :: held 3.055s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "cinder-667470a8-ad34-4695-afa7-f632f316987d-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:07 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-667470a8-ad34-4695-afa7-f632f316987d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:08 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "cinder-quobyte-667470a8-ad34-4695-afa7-f632f316987d" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:08 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-quobyte-667470a8-ad34-4695-afa7-f632f316987d" acquired by "delete_volume" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:08 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31098f18-f895-49c1-a22c-31fc641cc547]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d" returned: 0 in 0.999s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-667470a8-ad34-4695-afa7-f632f316987d" returned: 0 in 0.299s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-quobyte-667470a8-ad34-4695-afa7-f632f316987d" released by "delete_volume" :: held 1.683s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:10 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Created reservations ['5bcb9113-438c-415e-ba3f-b0380b2be24e', '1d0f90ff-fbe7-4f4f-bd4a-18b850e0f02c', 'a4f788ba-64a2-43cb-85aa-dc70a80ee909', '3ab03e5a-184f-4aae-871c-2892a315d38b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:56:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.272s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:11 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:56:11 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Deleted volume successfully.
Sep 17 19:56:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "cinder-5e5456f0-aa90-466f-9437-95cd6adb87b1-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-5e5456f0-aa90-466f-9437-95cd6adb87b1-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f08a49c9-df5d-4d3c-86fa-c3200600ca33 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-667470a8-ad34-4695-afa7-f632f316987d-delete_volume" released by "delete_volume" :: held 4.576s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "cinder-quobyte-5e5456f0-aa90-466f-9437-95cd6adb87b1" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-quobyte-5e5456f0-aa90-466f-9437-95cd6adb87b1" acquired by "delete_volume" :: waited 0.026s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:12 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c4c4d-74dd-490e-8e5e-75672f5e29a4]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5e5456f0-aa90-466f-9437-95cd6adb87b1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:13 devstack quobyte-client[83143]: System call of process 99201 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:56:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5e5456f0-aa90-466f-9437-95cd6adb87b1" returned: 0 in 0.755s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5e5456f0-aa90-466f-9437-95cd6adb87b1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-5e5456f0-aa90-466f-9437-95cd6adb87b1" returned: 0 in 0.257s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-quobyte-5e5456f0-aa90-466f-9437-95cd6adb87b1" released by "delete_volume" :: held 1.306s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Created reservations ['f4777c35-caf6-4944-b7d2-a23cf7c3ab89', '3f0f26f7-ffc3-4748-bf16-3c95cc236db1', 'feba0c84-4a5c-4304-afda-9eb62cd9b677', '7cf565b7-e428-48c6-8541-62d108938aa8'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.180s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:14 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:56:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Deleted volume successfully.
Sep 17 19:56:15 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-88ec93ca-626d-4833-b689-fd38d48566d7 tempest-CinderUnicodeTest-840345384 None] Lock "cinder-5e5456f0-aa90-466f-9437-95cd6adb87b1-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:15 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:15 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:56:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Flow 'volume_create_manager' (4b00602a-0c7a-4921-a727-436bd68a91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccddaf3-ca4e-4232-810d-f16ea539b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccddaf3-ca4e-4232-810d-f16ea539b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1926573947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171d56d1-d00d-4812-98df-e49f7b4d5319,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f35dfb787d04b2c9b46a985d05abccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:56:16Z,use_quota=True,user_id='8792f55f45eb4f038cbcf3e7811f4797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d253c48-6aff-42fb-9ecf-ae9ffdf52c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d253c48-6aff-42fb-9ecf-ae9ffdf52c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04551254-64e3-4f89-bb12-1b82a5ad22c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04551254-64e3-4f89-bb12-1b82a5ad22c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171d56d1-d00d-4812-98df-e49f7b4d5319', 'volume_name': 'volume-171d56d1-d00d-4812-98df-e49f7b4d5319', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aef817c-789f-478b-9fba-45fe6dda91e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aef817c-789f-478b-9fba-45fe6dda91e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17eedf4a-0394-44ab-b6ee-c201cfd5714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:16 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Volume 171d56d1-d00d-4812-98df-e49f7b4d5319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171d56d1-d00d-4812-98df-e49f7b4d5319', 'volume_size': 1}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1926573947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171d56d1-d00d-4812-98df-e49f7b4d5319,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f35dfb787d04b2c9b46a985d05abccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:56:16Z,use_quota=True,user_id='8792f55f45eb4f038cbcf3e7811f4797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Creating volume 171d56d1-d00d-4812-98df-e49f7b4d5319 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:56:16 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-171d56d1-d00d-4812-98df-e49f7b4d5319 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:16 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=128, name=volume-171d56d1-d00d-4812-98df-e49f7b4d5319, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-171d56d1-d00d-4812-98df-e49f7b4d5319 1073741824" returned: 0 in 0.421s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-171d56d1-d00d-4812-98df-e49f7b4d5319 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-171d56d1-d00d-4812-98df-e49f7b4d5319" returned: 0 in 0.316s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] <== create_volume: return (818ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:56:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17eedf4a-0394-44ab-b6ee-c201cfd5714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171d56d1-d00d-4812-98df-e49f7b4d5319', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded12c6d-76a1-465a-86ca-221a47c6a486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Volume volume-171d56d1-d00d-4812-98df-e49f7b4d5319 (171d56d1-d00d-4812-98df-e49f7b4d5319): created successfully
Sep 17 19:56:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded12c6d-76a1-465a-86ca-221a47c6a486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Flow 'volume_create_manager' (4b00602a-0c7a-4921-a727-436bd68a91da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:17 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-799ea29e-f6f5-4bda-873b-bc062796a757 tempest-VolumesListTestJSON-1015194988 None] Created volume successfully.
Sep 17 19:56:18 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Flow 'volume_create_manager' (1b7c4f9f-6fb4-44eb-8b4d-75da38b2271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87b330e-d759-4974-bedf-e6cb80dc61f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87b330e-d759-4974-bedf-e6cb80dc61f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1618536830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d27b518-1d62-4b95-86d9-46a674a28a41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f35dfb787d04b2c9b46a985d05abccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:56:18Z,use_quota=True,user_id='8792f55f45eb4f038cbcf3e7811f4797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d689be8f-08e0-4811-a19f-22da4989076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d689be8f-08e0-4811-a19f-22da4989076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fd6f01-54ea-415b-9f52-775c71b94a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fd6f01-54ea-415b-9f52-775c71b94a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d27b518-1d62-4b95-86d9-46a674a28a41', 'volume_name': 'volume-0d27b518-1d62-4b95-86d9-46a674a28a41', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7d4ed-b6fb-4533-833d-55975caec665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7d4ed-b6fb-4533-833d-55975caec665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef1e75f-5008-4509-81a9-fd98fe75e1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Volume 0d27b518-1d62-4b95-86d9-46a674a28a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d27b518-1d62-4b95-86d9-46a674a28a41', 'volume_size': 1}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1618536830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d27b518-1d62-4b95-86d9-46a674a28a41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f35dfb787d04b2c9b46a985d05abccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:56:18Z,use_quota=True,user_id='8792f55f45eb4f038cbcf3e7811f4797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Creating volume 0d27b518-1d62-4b95-86d9-46a674a28a41 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:56:18 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:56:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0d27b518-1d62-4b95-86d9-46a674a28a41 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:18 devstack quobyte-client[83143]: System call of process 99211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:56:18 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=129, name=volume-0d27b518-1d62-4b95-86d9-46a674a28a41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0d27b518-1d62-4b95-86d9-46a674a28a41 1073741824" returned: 0 in 0.357s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0d27b518-1d62-4b95-86d9-46a674a28a41 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0d27b518-1d62-4b95-86d9-46a674a28a41" returned: 0 in 0.102s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] <== create_volume: return (537ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.551s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef1e75f-5008-4509-81a9-fd98fe75e1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d27b518-1d62-4b95-86d9-46a674a28a41', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b84e30-2f72-4755-a9db-739b3c96be19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:19 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Volume volume-0d27b518-1d62-4b95-86d9-46a674a28a41 (0d27b518-1d62-4b95-86d9-46a674a28a41): created successfully
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b84e30-2f72-4755-a9db-739b3c96be19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Flow 'volume_create_manager' (1b7c4f9f-6fb4-44eb-8b4d-75da38b2271f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=117,cinder:SELECT=71,cinder:INSERT=24,cinder:DELETE=10 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:56:19 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2da20489-7cf2-4810-9669-54f3be3ec8df tempest-VolumesListTestJSON-1015194988 None] Created volume successfully.
Sep 17 19:56:19 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=131,cinder:SELECT=82,cinder:DELETE=12,cinder:INSERT=32 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:56:21 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Flow 'volume_create_manager' (af625e5f-c92e-438a-9b09-ea72d8b521a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1576013-819a-4dce-9e0f-9a1e8b02f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1576013-819a-4dce-9e0f-9a1e8b02f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-104246944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a34f1a-4d9f-410e-8ba2-24119687dfb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f35dfb787d04b2c9b46a985d05abccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:56:21Z,use_quota=True,user_id='8792f55f45eb4f038cbcf3e7811f4797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b156f21-65b3-42e5-8e1e-279c138ad725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b156f21-65b3-42e5-8e1e-279c138ad725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63c72e7-7d40-4bf3-b64b-a70bfa5c321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63c72e7-7d40-4bf3-b64b-a70bfa5c321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74a34f1a-4d9f-410e-8ba2-24119687dfb0', 'volume_name': 'volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77a7a2d-33c3-4420-8322-fda1a6d8c600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77a7a2d-33c3-4420-8322-fda1a6d8c600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124f0062-7ca5-43c2-97a4-5cdd87fca059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:21 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Volume 74a34f1a-4d9f-410e-8ba2-24119687dfb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0', 'volume_size': 1}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-104246944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a34f1a-4d9f-410e-8ba2-24119687dfb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f35dfb787d04b2c9b46a985d05abccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:56:21Z,use_quota=True,user_id='8792f55f45eb4f038cbcf3e7811f4797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Creating volume 74a34f1a-4d9f-410e-8ba2-24119687dfb0 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:56:21 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:21 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=130, name=volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0 1073741824" returned: 0 in 0.307s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0" returned: 0 in 0.084s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] <== create_volume: return (455ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.467s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124f0062-7ca5-43c2-97a4-5cdd87fca059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:21 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15b1911-79b8-4826-b5f5-ff9b2c448b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:22 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Volume volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0 (74a34f1a-4d9f-410e-8ba2-24119687dfb0): created successfully
Sep 17 19:56:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15b1911-79b8-4826-b5f5-ff9b2c448b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Flow 'volume_create_manager' (af625e5f-c92e-438a-9b09-ea72d8b521a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c8a0574f-9ea2-4baf-b79c-0be14ebba2bb tempest-VolumesListTestJSON-1015194988 None] Created volume successfully.
Sep 17 19:56:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "cinder-74a34f1a-4d9f-410e-8ba2-24119687dfb0-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:25 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-74a34f1a-4d9f-410e-8ba2-24119687dfb0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:26 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "cinder-quobyte-74a34f1a-4d9f-410e-8ba2-24119687dfb0" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-quobyte-74a34f1a-4d9f-410e-8ba2-24119687dfb0" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82302bf-1832-4547-92a4-411ef8263f7d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0" returned: 0 in 0.391s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74a34f1a-4d9f-410e-8ba2-24119687dfb0" returned: 0 in 0.109s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-quobyte-74a34f1a-4d9f-410e-8ba2-24119687dfb0" released by "delete_volume" :: held 0.633s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:26 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Created reservations ['0e77af48-314d-4820-9373-a8643205910f', '6157bf2c-d5e7-44c2-afb2-d0e52caf68ee', '9a6f7c15-e03a-4f9a-aea3-db47deee0490', 'bbb882d7-8454-4102-a3c2-48c96f760507'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.105s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:56:27 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Deleted volume successfully.
Sep 17 19:56:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d7942e39-02ad-4734-a700-76f939c92540 tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-74a34f1a-4d9f-410e-8ba2-24119687dfb0-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "cinder-0d27b518-1d62-4b95-86d9-46a674a28a41-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-0d27b518-1d62-4b95-86d9-46a674a28a41-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:28 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "cinder-quobyte-0d27b518-1d62-4b95-86d9-46a674a28a41" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-quobyte-0d27b518-1d62-4b95-86d9-46a674a28a41" acquired by "delete_volume" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:28 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3840fcba-10fc-4583-af38-d4969d6bfbf3]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0d27b518-1d62-4b95-86d9-46a674a28a41 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0d27b518-1d62-4b95-86d9-46a674a28a41" returned: 0 in 0.453s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0d27b518-1d62-4b95-86d9-46a674a28a41 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0d27b518-1d62-4b95-86d9-46a674a28a41" returned: 0 in 0.100s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-quobyte-0d27b518-1d62-4b95-86d9-46a674a28a41" released by "delete_volume" :: held 0.739s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Created reservations ['26fa56ca-a13d-44c0-b0bd-1e7d7244ba49', 'a87f5edb-ba41-45c0-b117-d508ca21d37b', '45a8cece-b83a-4dc8-a32f-08255b46119a', '4a97a8b8-fa3f-499c-9939-a71fdad5066a'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.094s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:29 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:56:29 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Deleted volume successfully.
Sep 17 19:56:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-1fcf29a1-3a3d-44db-b20a-a6f045e2b06c tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-0d27b518-1d62-4b95-86d9-46a674a28a41-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "cinder-171d56d1-d00d-4812-98df-e49f7b4d5319-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-171d56d1-d00d-4812-98df-e49f7b4d5319-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:30 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "cinder-quobyte-171d56d1-d00d-4812-98df-e49f7b4d5319" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:56:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-quobyte-171d56d1-d00d-4812-98df-e49f7b4d5319" acquired by "delete_volume" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:56:30 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f805bfa-3475-4130-9fc4-67c45fa60c84]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-171d56d1-d00d-4812-98df-e49f7b4d5319 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-171d56d1-d00d-4812-98df-e49f7b4d5319" returned: 0 in 0.595s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-171d56d1-d00d-4812-98df-e49f7b4d5319 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-171d56d1-d00d-4812-98df-e49f7b4d5319" returned: 0 in 0.202s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-quobyte-171d56d1-d00d-4812-98df-e49f7b4d5319" released by "delete_volume" :: held 1.070s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Created reservations ['20b5a34a-5133-4f5c-bbaa-b7044d369e5c', '4f9cadde-f6f0-43ba-871e-df78bb5525e8', '4d5adfa1-a486-49ed-a4c7-63e99e362801', '5dcd5c35-de8d-4378-b3c9-0d299308926e'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.095s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:32 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:56:32 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Deleted volume successfully.
Sep 17 19:56:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b5770353-a37b-477a-ad5f-b0d1e8105e32 tempest-VolumesListTestJSON-1015194988 None] Lock "cinder-171d56d1-d00d-4812-98df-e49f7b4d5319-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:56:36 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Flow 'volume_create_manager' (940b7b86-d611-4e12-9e4c-7d6053cba5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d5fc01-006e-4113-8209-6e7e9183c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d5fc01-006e-4113-8209-6e7e9183c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-236861407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ada5b9-4f38-409a-8290-633b1116562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb248c2ca1f941399072d352df7889ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:56:37Z,use_quota=True,user_id='ca583be8b2cc4725af7cc02a6e252c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47360307-8df5-4af1-9185-6ab0ad7fe30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47360307-8df5-4af1-9185-6ab0ad7fe30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736bdb02-885a-4838-9af9-5062abe7e2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736bdb02-885a-4838-9af9-5062abe7e2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ada5b9-4f38-409a-8290-633b1116562d', 'volume_name': 'volume-96ada5b9-4f38-409a-8290-633b1116562d', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73538a7-2dcc-4a5c-aa8c-72719b37fda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73538a7-2dcc-4a5c-aa8c-72719b37fda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a756e31-7b37-4b10-90ab-45fefabddcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:36 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Volume 96ada5b9-4f38-409a-8290-633b1116562d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ada5b9-4f38-409a-8290-633b1116562d', 'volume_size': 1}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-236861407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ada5b9-4f38-409a-8290-633b1116562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb248c2ca1f941399072d352df7889ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:56:37Z,use_quota=True,user_id='ca583be8b2cc4725af7cc02a6e252c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Creating volume 96ada5b9-4f38-409a-8290-633b1116562d {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:56:36 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:56:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-96ada5b9-4f38-409a-8290-633b1116562d 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:37 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=131, name=volume-96ada5b9-4f38-409a-8290-633b1116562d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-96ada5b9-4f38-409a-8290-633b1116562d 1073741824" returned: 0 in 0.350s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-96ada5b9-4f38-409a-8290-633b1116562d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-96ada5b9-4f38-409a-8290-633b1116562d" returned: 0 in 0.099s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] <== create_volume: return (521ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.535s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a756e31-7b37-4b10-90ab-45fefabddcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ada5b9-4f38-409a-8290-633b1116562d', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2da0a16-438d-47fd-9af0-9c58800b78e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:56:37 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Volume volume-96ada5b9-4f38-409a-8290-633b1116562d (96ada5b9-4f38-409a-8290-633b1116562d): created successfully
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2da0a16-438d-47fd-9af0-9c58800b78e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:56:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Flow 'volume_create_manager' (940b7b86-d611-4e12-9e4c-7d6053cba5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:56:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e2a9e6ef-1462-4f53-8bfe-ed555e138727 tempest-VolumesNegativeTest-239144476 None] Created volume successfully.
Sep 17 19:56:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=19,cinder:UPDATE=18,cinder:INSERT=9,cinder:DELETE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:56:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=15,cinder:UPDATE=38,cinder:DELETE=3,cinder:INSERT=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:56:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-d8208442-bc00-47a7-b5a2-0a1e9cbc8c92 req-682c4945-8aa4-4884-b97b-357e896fe23b tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-d8208442-bc00-47a7-b5a2-0a1e9cbc8c92 req-682c4945-8aa4-4884-b97b-357e896fe23b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:51 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca91c2e0-391f-4601-b09a-7750e292d255]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:56:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-d8208442-bc00-47a7-b5a2-0a1e9cbc8c92 req-682c4945-8aa4-4884-b97b-357e896fe23b tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-d8208442-bc00-47a7-b5a2-0a1e9cbc8c92 req-682c4945-8aa4-4884-b97b-357e896fe23b tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0" returned: 0 in 0.443s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-d8208442-bc00-47a7-b5a2-0a1e9cbc8c92 req-682c4945-8aa4-4884-b97b-357e896fe23b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.515s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:52 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-d8208442-bc00-47a7-b5a2-0a1e9cbc8c92 req-682c4945-8aa4-4884-b97b-357e896fe23b tempest-TestServerVolumeAttachmentScenario-295576274 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2b759f3-61ef-49e9-9950-39766105bcb1', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:56:52 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-d8208442-bc00-47a7-b5a2-0a1e9cbc8c92 req-682c4945-8aa4-4884-b97b-357e896fe23b tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:56:52 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-d8208442-bc00-47a7-b5a2-0a1e9cbc8c92 req-682c4945-8aa4-4884-b97b-357e896fe23b tempest-TestServerVolumeAttachmentScenario-295576274 None] attachment_update completed successfully.
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.132s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:56:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:57:02 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:57:02 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:57:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-19c5896c-7bb8-473e-ac28-a536ff3ab5e3 req-687fdd64-4005-4575-8b26-9ed6741d4663 tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-19c5896c-7bb8-473e-ac28-a536ff3ab5e3 req-687fdd64-4005-4575-8b26-9ed6741d4663 tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:07 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ce93d6-0462-4001-9e8e-61869dc4b5fa]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:57:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-19c5896c-7bb8-473e-ac28-a536ff3ab5e3 req-687fdd64-4005-4575-8b26-9ed6741d4663 tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-19c5896c-7bb8-473e-ac28-a536ff3ab5e3 req-687fdd64-4005-4575-8b26-9ed6741d4663 tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d" returned: 0 in 0.509s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-19c5896c-7bb8-473e-ac28-a536ff3ab5e3 req-687fdd64-4005-4575-8b26-9ed6741d4663 tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.598s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-19c5896c-7bb8-473e-ac28-a536ff3ab5e3 req-687fdd64-4005-4575-8b26-9ed6741d4663 tempest-TestServerVolumeAttachmentScenario-295576274 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c00f5830-74c6-45e8-a54b-bfd50f4654f8', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:57:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-19c5896c-7bb8-473e-ac28-a536ff3ab5e3 req-687fdd64-4005-4575-8b26-9ed6741d4663 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:57:09 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-19c5896c-7bb8-473e-ac28-a536ff3ab5e3 req-687fdd64-4005-4575-8b26-9ed6741d4663 tempest-TestServerVolumeAttachmentScenario-295576274 None] attachment_update completed successfully.
Sep 17 19:57:19 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:57:19 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Acquiring lock "cinder-96ada5b9-4f38-409a-8290-633b1116562d-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Lock "cinder-96ada5b9-4f38-409a-8290-633b1116562d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:57:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Acquiring lock "cinder-quobyte-96ada5b9-4f38-409a-8290-633b1116562d" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Lock "cinder-quobyte-96ada5b9-4f38-409a-8290-633b1116562d" acquired by "delete_volume" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a74c01-6d84-4f82-ab40-542fd2c28e31]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-96ada5b9-4f38-409a-8290-633b1116562d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-96ada5b9-4f38-409a-8290-633b1116562d" returned: 0 in 0.405s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-96ada5b9-4f38-409a-8290-633b1116562d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-96ada5b9-4f38-409a-8290-633b1116562d" returned: 0 in 0.103s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Lock "cinder-quobyte-96ada5b9-4f38-409a-8290-633b1116562d" released by "delete_volume" :: held 0.647s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Created reservations ['e0718da6-eab0-46ce-9b46-113b7fe4dfed', '553554a8-5930-4f2a-88e8-2b5a5d8c03d5', '62cdd574-02de-4212-9f98-3df142d184f9', '5dbadd90-1750-4656-897c-34c11eb22c02'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.121s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:57:24 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Deleted volume successfully.
Sep 17 19:57:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6ed72e9a-4350-48ba-bba1-29e6f2a4c150 tempest-VolumesNegativeTest-239144476 None] Lock "cinder-96ada5b9-4f38-409a-8290-633b1116562d-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:57:34 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:57:34 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:57:37 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-d3caa407-a85a-48f2-8676-28a33c1c38e2 req-3664c132-72d0-47ac-a755-50bef0fa5622 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:57:37 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-d3caa407-a85a-48f2-8676-28a33c1c38e2 req-3664c132-72d0-47ac-a755-50bef0fa5622 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:57:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-d3caa407-a85a-48f2-8676-28a33c1c38e2 req-3664c132-72d0-47ac-a755-50bef0fa5622 tempest-TestServerVolumeAttachmentScenario-295576274 None] Terminate volume connection completed successfully.
Sep 17 19:57:37 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-d3caa407-a85a-48f2-8676-28a33c1c38e2 req-3664c132-72d0-47ac-a755-50bef0fa5622 tempest-TestServerVolumeAttachmentScenario-295576274 None] Deleting attachment c00f5830-74c6-45e8-a54b-bfd50f4654f8. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:57:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:57:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:57:48 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Flow 'volume_create_manager' (ee9c742a-79c6-4614-b69b-c9e1f4c57bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bda7281-b4f9-4c60-8ac7-a6d66c3d0f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bda7281-b4f9-4c60-8ac7-a6d66c3d0f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-363636770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c10cd22635d41e58b99c2e0ecee74c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:57:48Z,use_quota=True,user_id='6d9f1777d07841088a06866c5ef2dc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9610424-e4e1-47cb-8512-809791accf35),volume_type_id=e9610424-e4e1-47cb-8512-809791accf35)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e53f4e4-17d0-4aaa-8a8b-f3fd4f82c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e53f4e4-17d0-4aaa-8a8b-f3fd4f82c259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e915e9-8d4c-4437-ba37-a0e1763528d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e915e9-8d4c-4437-ba37-a0e1763528d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4', 'volume_name': 'volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65b07d8-4cc4-46b6-9485-ecb82886d023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65b07d8-4cc4-46b6-9485-ecb82886d023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39abc80d-4a1e-4239-a3c6-f6b5b6ecee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:48 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4', 'volume_size': 1}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-363636770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c10cd22635d41e58b99c2e0ecee74c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:57:48Z,use_quota=True,user_id='6d9f1777d07841088a06866c5ef2dc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9610424-e4e1-47cb-8512-809791accf35),volume_type_id=e9610424-e4e1-47cb-8512-809791accf35)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Creating volume bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:57:48 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:48 devstack quobyte-client[83143]: System call of process 99977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:57:48 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=132, name=volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4 1073741824" returned: 0 in 0.582s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4" returned: 0 in 0.265s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] <== create_volume: return (897ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:49 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Flow 'volume_create_manager' (19c0f60d-2e3f-456e-b090-87b11e8eb8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb9b3e5-40dd-450c-8ca9-3964f9593c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb9b3e5-40dd-450c-8ca9-3964f9593c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-824955598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa736e0a-984a-4ba3-9b2c-7ddea332817c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c10cd22635d41e58b99c2e0ecee74c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:57:49Z,use_quota=True,user_id='6d9f1777d07841088a06866c5ef2dc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59052e53-ba2a-4b41-b81c-dd429b1cf060),volume_type_id=59052e53-ba2a-4b41-b81c-dd429b1cf060)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0ec808-4649-498e-97b7-72d4cfc64d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0ec808-4649-498e-97b7-72d4cfc64d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae63811d-60ba-4c14-b075-797a2ca90ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae63811d-60ba-4c14-b075-797a2ca90ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa736e0a-984a-4ba3-9b2c-7ddea332817c', 'volume_name': 'volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fcb07e-58c3-4be1-853c-d4f438ce4caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fcb07e-58c3-4be1-853c-d4f438ce4caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924a97c4-2af1-42fc-ba6e-f562d45648d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:49 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume fa736e0a-984a-4ba3-9b2c-7ddea332817c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c', 'volume_size': 1}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-824955598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa736e0a-984a-4ba3-9b2c-7ddea332817c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c10cd22635d41e58b99c2e0ecee74c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:57:49Z,use_quota=True,user_id='6d9f1777d07841088a06866c5ef2dc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59052e53-ba2a-4b41-b81c-dd429b1cf060),volume_type_id=59052e53-ba2a-4b41-b81c-dd429b1cf060)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Creating volume fa736e0a-984a-4ba3-9b2c-7ddea332817c {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:57:49 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:49 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=133, name=volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39abc80d-4a1e-4239-a3c6-f6b5b6ecee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:49 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a0c297-28e2-4147-ae08-da846af1f49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c 1073741824" returned: 0 in 0.555s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:50 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4 (bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4): created successfully
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a0c297-28e2-4147-ae08-da846af1f49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Flow 'volume_create_manager' (ee9c742a-79c6-4614-b69b-c9e1f4c57bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c" returned: 0 in 0.337s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] <== create_volume: return (924ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:50 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0a0c5f3f-772c-4657-9aed-5f65be65be6e tempest-TestInstancesWithCinderVolumes-1832339358 None] Created volume successfully.
Sep 17 19:57:50 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Flow 'volume_create_manager' (64e0cfde-ab16-4566-a3ff-7511b4f61bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5845a243-005f-41b8-8e52-00683c6fa258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5845a243-005f-41b8-8e52-00683c6fa258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-731641279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf4fac2-21c7-4e11-bd16-ae6a52a414b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c10cd22635d41e58b99c2e0ecee74c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:57:49Z,use_quota=True,user_id='6d9f1777d07841088a06866c5ef2dc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fa71dd1-6e44-4ec2-ab86-6f22375901cd),volume_type_id=2fa71dd1-6e44-4ec2-ab86-6f22375901cd)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688e7713-f27a-4ea3-8033-7b3a3007abd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688e7713-f27a-4ea3-8033-7b3a3007abd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919173b9-7370-445f-b092-37ff5ed2f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.image.glance [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Creating Keystone auth plugin from conf {{(pid=83122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924a97c4-2af1-42fc-ba6e-f562d45648d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb33776b-b79f-44d8-8667-ead858944eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:50 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c (fa736e0a-984a-4ba3-9b2c-7ddea332817c): created successfully
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb33776b-b79f-44d8-8667-ead858944eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:50 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Flow 'volume_create_manager' (19c0f60d-2e3f-456e-b090-87b11e8eb8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:57:50 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a9606812-1eda-47a6-b891-ed968730452f tempest-TestInstancesWithCinderVolumes-1832339358 None] Created volume successfully.
Sep 17 19:57:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919173b9-7370-445f-b092-37ff5ed2f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3bf4fac2-21c7-4e11-bd16-ae6a52a414b2', 'volume_name': 'volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2', 'volume_size': 1, 'image_id': '71393c71-1d2f-4260-86d3-8f061e9fa53f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71393c71-1d2f-4260-86d3-8f061e9fa53f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1086084861', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c10cd22635d41e58b99c2e0ecee74c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71393c71-1d2f-4260-86d3-8f061e9fa53f', 'created_at': datetime.datetime(2025, 9, 17, 17, 57, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71393c71-1d2f-4260-86d3-8f061e9fa53f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842ce7a770>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c854977-dd05-4e71-8b3a-76462a7e203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c854977-dd05-4e71-8b3a-76462a7e203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:57:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4363340-8fc9-4c11-839e-e2c3ee818343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:57:51 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume 3bf4fac2-21c7-4e11-bd16-ae6a52a414b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2', 'volume_size': 1, 'image_id': '71393c71-1d2f-4260-86d3-8f061e9fa53f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71393c71-1d2f-4260-86d3-8f061e9fa53f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1086084861', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c10cd22635d41e58b99c2e0ecee74c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71393c71-1d2f-4260-86d3-8f061e9fa53f', 'created_at': datetime.datetime(2025, 9, 17, 17, 57, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71393c71-1d2f-4260-86d3-8f061e9fa53f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842ce7a770>}
Sep 17 19:57:51 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Cloning 3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 from image 71393c71-1d2f-4260-86d3-8f061e9fa53f  at location (None, [{'url': 'file:///opt/stack/data/glance/images/71393c71-1d2f-4260-86d3-8f061e9fa53f', 'metadata': {}}]). {{(pid=83122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 19:57:52 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD, size 20.69 MB, duration 1.46 sec {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 19:57:52 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Image download 20.69 MB at 14.22 MB/s
Sep 17 19:57:52 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b215a8-d76f-4817-aa7d-f07f8313f9ca]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:57:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:52 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD
Sep 17 19:57:52 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:57:54 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD" returned: 0 in 2.011s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Temporary image 71393c71-1d2f-4260-86d3-8f061e9fa53f is fetched for user 6d9f1777d07841088a06866c5ef2dc66. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.234s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:57:55 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7511d5-8922-4041-a9c3-42f48c0188b0]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:57:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:55 devstack sudo[99992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD
Sep 17 19:57:55 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:57:57 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD" returned: 0 in 2.047s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-731641279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf4fac2-21c7-4e11-bd16-ae6a52a414b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c10cd22635d41e58b99c2e0ecee74c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:57:49Z,use_quota=True,user_id='6d9f1777d07841088a06866c5ef2dc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fa71dd1-6e44-4ec2-ab86-6f22375901cd),volume_type_id=2fa71dd1-6e44-4ec2-ab86-6f22375901cd)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Creating volume 3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:57:57 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:57 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=134, name=volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 1073741824" returned: 0 in 0.320s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 0 in 0.094s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:57:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.538s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:57:58 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Attempting download of 71393c71-1d2f-4260-86d3-8f061e9fa53f ((None, [{'url': 'file:///opt/stack/data/glance/images/71393c71-1d2f-4260-86d3-8f061e9fa53f', 'metadata': {}}])) to volume 3bf4fac2-21c7-4e11-bd16-ae6a52a414b2. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 19:57:58 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d73b87-b816-419b-a392-34b5fa98cbb1]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:57:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71393c71-1d2f-4260-86d3-8f061e9fa53f_a7axttao {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71393c71-1d2f-4260-86d3-8f061e9fa53f_a7axttao" returned: 0 in 0.373s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71393c71-1d2f-4260-86d3-8f061e9fa53f_a7axttao {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71393c71-1d2f-4260-86d3-8f061e9fa53f_a7axttao" returned: 1 in 0.375s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71393c71-1d2f-4260-86d3-8f061e9fa53f_a7axttao' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:57:59 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb38f2-51fd-43e3-8163-3259db5f40d6]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:57:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:57:59 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] 71393c71-1d2f-4260-86d3-8f061e9fa53f was qcow2, converting to raw {{(pid=83122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 19:57:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:57:59 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=134, name=volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:58:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 0 in 1.083s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:00 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71393c71-1d2f-4260-86d3-8f061e9fa53f_o093rodkdevstack@QuobyteHD, size 112.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:58:00 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Converted 112.00 MB image at 99.93 MB/s
Sep 17 19:58:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:00 devstack quobyte-client[83143]: System call of process 100014 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:58:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 1G" returned: 0 in 0.169s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:00 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e312c7-8523-4e9c-b230-9e0ea6e22bee]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:58:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 0 in 0.385s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 1 in 0.361s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Downloaded image 71393c71-1d2f-4260-86d3-8f061e9fa53f ((None, [{'url': 'file:///opt/stack/data/glance/images/71393c71-1d2f-4260-86d3-8f061e9fa53f', 'metadata': {}}])) to volume 3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 successfully. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Temporary image 71393c71-1d2f-4260-86d3-8f061e9fa53f for user 6d9f1777d07841088a06866c5ef2dc66 is deleted. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Marking volume 3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 as bootable. {{(pid=83122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Copying metadata from image 71393c71-1d2f-4260-86d3-8f061e9fa53f to 3bf4fac2-21c7-4e11-bd16-ae6a52a414b2. {{(pid=83122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 19:58:01 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Creating volume glance metadata for volume 3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 backed by image 71393c71-1d2f-4260-86d3-8f061e9fa53f with: {'image_id': '71393c71-1d2f-4260-86d3-8f061e9fa53f', 'image_name': 'tempest-scenario-img--1086084861', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 19:58:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4363340-8fc9-4c11-839e-e2c3ee818343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2', 'volume_size': 1, 'image_id': '71393c71-1d2f-4260-86d3-8f061e9fa53f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71393c71-1d2f-4260-86d3-8f061e9fa53f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1086084861', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c10cd22635d41e58b99c2e0ecee74c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71393c71-1d2f-4260-86d3-8f061e9fa53f', 'created_at': datetime.datetime(2025, 9, 17, 17, 57, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71393c71-1d2f-4260-86d3-8f061e9fa53f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842ce7a770>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:58:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495df7d2-d174-42ec-bdde-0615ab46e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:58:02 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 (3bf4fac2-21c7-4e11-bd16-ae6a52a414b2): created successfully
Sep 17 19:58:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495df7d2-d174-42ec-bdde-0615ab46e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:58:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Flow 'volume_create_manager' (64e0cfde-ab16-4566-a3ff-7511b4f61bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:58:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4fd73de7-9b9b-47eb-92ef-d74b3bf80dc0 tempest-TestInstancesWithCinderVolumes-1832339358 None] Created volume successfully.
Sep 17 19:58:02 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-9b602356-cfad-40a5-b486-a5535d9f4ef3 req-e479f50e-9cd9-48a5-a64f-91ef88f7cbf0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:58:02 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-9b602356-cfad-40a5-b486-a5535d9f4ef3 req-e479f50e-9cd9-48a5-a64f-91ef88f7cbf0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:58:02 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-9b602356-cfad-40a5-b486-a5535d9f4ef3 req-e479f50e-9cd9-48a5-a64f-91ef88f7cbf0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Terminate volume connection completed successfully.
Sep 17 19:58:02 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-9b602356-cfad-40a5-b486-a5535d9f4ef3 req-e479f50e-9cd9-48a5-a64f-91ef88f7cbf0 tempest-TestServerVolumeAttachmentScenario-295576274 None] Deleting attachment b2b759f3-61ef-49e9-9950-39766105bcb1. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 19:58:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:58:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:58:11 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad85116-b333-41fb-980f-895bd2ea4b9d]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:58:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:12 devstack quobyte-client[83143]: System call of process 100078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:58:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 0 in 0.554s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 1 in 0.551s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:58:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.341s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:58:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '784bb682-d236-495d-b2d5-fdf64a850ea4', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:58:13 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:58:13 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-c60afd56-be7b-4bf8-9998-0ea3083afe0c req-d4c053ff-4347-4bb5-ac43-7dd96764706b tempest-TestInstancesWithCinderVolumes-1832339358 None] attachment_update completed successfully.
Sep 17 19:58:16 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "cinder-aa9d149d-9cbd-4dc6-9737-387f24aa146d-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:58:16 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "cinder-aa9d149d-9cbd-4dc6-9737-387f24aa146d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:58:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:58:16 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "cinder-quobyte-aa9d149d-9cbd-4dc6-9737-387f24aa146d" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:58:16 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "cinder-quobyte-aa9d149d-9cbd-4dc6-9737-387f24aa146d" acquired by "delete_volume" :: waited 0.017s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:58:16 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5779f69-8ced-470c-8bd8-75467a0f632c]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:58:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:17 devstack quobyte-client[83143]: System call of process 100085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:58:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d" returned: 0 in 0.606s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-aa9d149d-9cbd-4dc6-9737-387f24aa146d" returned: 0 in 0.141s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:17 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "cinder-quobyte-aa9d149d-9cbd-4dc6-9737-387f24aa146d" released by "delete_volume" :: held 0.979s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:58:17 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Created reservations ['288b3e95-c98a-4329-b1fe-4e7202b36352', 'b9544fd4-203f-471f-b57b-057b2e19f247', 'f75122cf-9dab-4503-b70a-7a720b006c9b', 'b2f7c126-2133-4ed8-8674-ac8aedc3880c'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.158s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:58:18 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Deleted volume successfully.
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e48018-0317-4975-8dfc-11e91f4939cb tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "cinder-aa9d149d-9cbd-4dc6-9737-387f24aa146d-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "cinder-c0fde6ca-ded2-47e8-b219-8a1be67daff0-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:58:18 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "cinder-c0fde6ca-ded2-47e8-b219-8a1be67daff0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:58:19 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:58:19 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "cinder-quobyte-c0fde6ca-ded2-47e8-b219-8a1be67daff0" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:58:19 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "cinder-quobyte-c0fde6ca-ded2-47e8-b219-8a1be67daff0" acquired by "delete_volume" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:58:19 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e247da16-28ce-4b54-9006-625573daa9b6]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:58:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0" returned: 0 in 0.517s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c0fde6ca-ded2-47e8-b219-8a1be67daff0" returned: 0 in 0.124s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:20 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "cinder-quobyte-c0fde6ca-ded2-47e8-b219-8a1be67daff0" released by "delete_volume" :: held 0.912s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:58:20 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Created reservations ['c5203151-40d2-41f5-8ff1-a959d260c137', 'bd56b565-1daf-440a-96f9-9de2db20f2ea', 'be18438a-9b40-4b6b-9963-1eec7661dd88', '5b82c780-d8cd-4936-9c7c-83d906f27bd3'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:58:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:58:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:58:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:58:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:58:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:58:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.216s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:21 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:58:21 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Deleted volume successfully.
Sep 17 19:58:21 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e7e5fca1-098a-4c2b-b9e8-719949c21a2b tempest-TestServerVolumeAttachmentScenario-295576274 None] Lock "cinder-c0fde6ca-ded2-47e8-b219-8a1be67daff0-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:58:30 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=7 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:58:31 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=21,cinder:SELECT=24,cinder:INSERT=10,cinder:DELETE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.189s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:58:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:58:55 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 19:58:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Flow 'volume_create_manager' (065ba473-07bc-4139-85ad-71626cec2c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:58:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca438f3-ccef-44ba-b6ec-5e9d1c4749ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca438f3-ccef-44ba-b6ec-5e9d1c4749ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8f2928-3044-45d8-94aa-04dd265c586f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc76b0f2c01d4528ad5501215968f4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:58:56Z,use_quota=True,user_id='05b193eddb1d4535a6caddefc4c5bdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a8feab-2001-4ab3-a128-39da7dc1b826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a8feab-2001-4ab3-a128-39da7dc1b826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26feec05-afed-4933-9549-b6ad9d1ea77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.image.glance [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Creating Keystone auth plugin from conf {{(pid=83122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26feec05-afed-4933-9549-b6ad9d1ea77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd8f2928-3044-45d8-94aa-04dd265c586f', 'volume_name': 'volume-fd8f2928-3044-45d8-94aa-04dd265c586f', 'volume_size': 1, 'image_id': '7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f01be9fca6fb2477d6908f77174604a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc76b0f2c01d4528ad5501215968f4b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '993e8cc1dcf0efd1f0683f88dd62b0e5e75b7ae11b663999845d272b13cdc3d09745889cebed1a0e2eb9c61725465736b32db3d5bbf4a17268ebb9562a4e17fb', 'id': '7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'created_at': datetime.datetime(2025, 9, 17, 17, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8422a44550>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e637b45-82de-4ed5-a11d-7438b732f3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e637b45-82de-4ed5-a11d-7438b732f3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae473563-ef4a-49b4-8214-ab89f95621f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:58:56 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Volume fd8f2928-3044-45d8-94aa-04dd265c586f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd8f2928-3044-45d8-94aa-04dd265c586f', 'volume_size': 1, 'image_id': '7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f01be9fca6fb2477d6908f77174604a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc76b0f2c01d4528ad5501215968f4b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '993e8cc1dcf0efd1f0683f88dd62b0e5e75b7ae11b663999845d272b13cdc3d09745889cebed1a0e2eb9c61725465736b32db3d5bbf4a17268ebb9562a4e17fb', 'id': '7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'created_at': datetime.datetime(2025, 9, 17, 17, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8422a44550>}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Cloning fd8f2928-3044-45d8-94aa-04dd265c586f from image 7cf7829f-f3e7-4654-b134-5ae744dc16e0  at location (None, [{'url': 'file:///opt/stack/data/glance/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'metadata': {}}]). {{(pid=83122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 19:58:56 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Image download 0.00 MB at 0.00 MB/s
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[030db778-1ef8-4af5-830a-5998da80a0e2]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:58:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:57 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD
Sep 17 19:58:57 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:58:59 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Sep 17 19:58:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD" returned: 0 in 2.358s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:58:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:58:59 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD
Sep 17 19:58:59 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:59:01 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Sep 17 19:59:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD" returned: 1 in 2.307s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:59:01 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Temporary image 7cf7829f-f3e7-4654-b134-5ae744dc16e0 is fetched for user 05b193eddb1d4535a6caddefc4c5bdc1. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 19:59:01 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8143c9-d77d-4d48-bee1-694590990318]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:59:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:02 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD
Sep 17 19:59:02 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:59:04 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Sep 17 19:59:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD" returned: 0 in 2.285s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:04 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD
Sep 17 19:59:04 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 19:59:06 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD" returned: 1 in 2.298s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T17:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8f2928-3044-45d8-94aa-04dd265c586f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc76b0f2c01d4528ad5501215968f4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T17:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T17:58:56Z,use_quota=True,user_id='05b193eddb1d4535a6caddefc4c5bdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Creating volume fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 19:59:06 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 19:59:06 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:06 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=135, name=volume-fd8f2928-3044-45d8-94aa-04dd265c586f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f 1073741824" returned: 0 in 0.437s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f" returned: 0 in 0.101s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] <== create_volume: return (636ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Attempting download of 7cf7829f-f3e7-4654-b134-5ae744dc16e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'metadata': {}}])) to volume fd8f2928-3044-45d8-94aa-04dd265c586f. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f038bd5a-fda6-4c32-86a6-5dcbc8f9dee3]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7cf7829f-f3e7-4654-b134-5ae744dc16e0_8yc71758 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7cf7829f-f3e7-4654-b134-5ae744dc16e0_8yc71758" returned: 0 in 0.422s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:07 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cf7829f-f3e7-4654-b134-5ae744dc16e0_8yc71758 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cf7829f-f3e7-4654-b134-5ae744dc16e0_8yc71758" returned: 1 in 0.405s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cf7829f-f3e7-4654-b134-5ae744dc16e0_8yc71758' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:59:08 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd74b2c-5839-4917-8e12-f25eca36f383]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:59:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:59:09 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] 7cf7829f-f3e7-4654-b134-5ae744dc16e0 was raw, converting to raw {{(pid=83122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 19:59:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:09 devstack quobyte-client[83143]: System call of process 100676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 19:59:09 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=135, name=volume-fd8f2928-3044-45d8-94aa-04dd265c586f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 19:59:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f" returned: 0 in 0.213s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:09 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7cf7829f-f3e7-4654-b134-5ae744dc16e0_r1tr1hgxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 19:59:09 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Converted 0.00 MB image at 0.00 MB/s
Sep 17 19:59:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f 1G" returned: 0 in 0.245s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:10 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e80a2-61eb-44cd-a301-ef13bcf143ad]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:59:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f" returned: 0 in 0.427s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f" returned: 1 in 0.528s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Downloaded image 7cf7829f-f3e7-4654-b134-5ae744dc16e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'metadata': {}}])) to volume fd8f2928-3044-45d8-94aa-04dd265c586f successfully. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Temporary image 7cf7829f-f3e7-4654-b134-5ae744dc16e0 for user 05b193eddb1d4535a6caddefc4c5bdc1 is deleted. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Marking volume fd8f2928-3044-45d8-94aa-04dd265c586f as bootable. {{(pid=83122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Copying metadata from image 7cf7829f-f3e7-4654-b134-5ae744dc16e0 to fd8f2928-3044-45d8-94aa-04dd265c586f. {{(pid=83122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Creating volume glance metadata for volume fd8f2928-3044-45d8-94aa-04dd265c586f backed by image 7cf7829f-f3e7-4654-b134-5ae744dc16e0 with: {'image_id': '7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f01be9fca6fb2477d6908f77174604a5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae473563-ef4a-49b4-8214-ab89f95621f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8f2928-3044-45d8-94aa-04dd265c586f', 'volume_size': 1, 'image_id': '7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f01be9fca6fb2477d6908f77174604a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc76b0f2c01d4528ad5501215968f4b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '993e8cc1dcf0efd1f0683f88dd62b0e5e75b7ae11b663999845d272b13cdc3d09745889cebed1a0e2eb9c61725465736b32db3d5bbf4a17268ebb9562a4e17fb', 'id': '7cf7829f-f3e7-4654-b134-5ae744dc16e0', 'created_at': datetime.datetime(2025, 9, 17, 17, 58, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 17, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cf7829f-f3e7-4654-b134-5ae744dc16e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8422a44550>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df5e28e-e369-4524-a9b7-557999fbc8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 19:59:11 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Volume volume-fd8f2928-3044-45d8-94aa-04dd265c586f (fd8f2928-3044-45d8-94aa-04dd265c586f): created successfully
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df5e28e-e369-4524-a9b7-557999fbc8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 19:59:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Flow 'volume_create_manager' (065ba473-07bc-4139-85ad-71626cec2c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 19:59:11 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-35b5808a-6ed4-4376-9e58-675b3c006b2e tempest-VolumeImageDependencyTests-1595676169 None] Created volume successfully.
Sep 17 19:59:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Acquiring lock "cinder-fd8f2928-3044-45d8-94aa-04dd265c586f-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:59:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Lock "cinder-fd8f2928-3044-45d8-94aa-04dd265c586f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:59:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:59:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Acquiring lock "cinder-quobyte-fd8f2928-3044-45d8-94aa-04dd265c586f" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 19:59:12 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Lock "cinder-quobyte-fd8f2928-3044-45d8-94aa-04dd265c586f" acquired by "delete_volume" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 19:59:12 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5810ce-cecd-42aa-8c94-278d8ba6342f]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:59:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f" returned: 0 in 0.421s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f" returned: 1 in 0.526s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 19:59:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fd8f2928-3044-45d8-94aa-04dd265c586f" returned: 0 in 0.112s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:13 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Lock "cinder-quobyte-fd8f2928-3044-45d8-94aa-04dd265c586f" released by "delete_volume" :: held 1.305s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Created reservations ['4d5613e6-efac-4efc-908f-58c48113f19e', '8d1c6b77-a764-4b82-b9f8-40fdca34ab51', 'd836a8f2-1a15-43d0-8ffd-9f81f34e44c3', 'a14f076b-2adb-4b94-8263-c2c9686b36ba'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.119s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 19:59:14 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Deleted volume successfully.
Sep 17 19:59:14 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cf8afccd-9f48-4719-a84b-f3dc79f11377 tempest-VolumeImageDependencyTests-1595676169 None] Lock "cinder-fd8f2928-3044-45d8-94aa-04dd265c586f-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 19:59:24 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=13,cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:59:24 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=14,cinder:INSERT=11,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 19:59:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8bb9cd3-df5b-4e20-ae08-1a42ae0a235d req-9a4ad38a-a1d1-4488-ad1c-bbec4bcae47b tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:59:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8bb9cd3-df5b-4e20-ae08-1a42ae0a235d req-9a4ad38a-a1d1-4488-ad1c-bbec4bcae47b tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:59:39 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[44628cb6-83a5-4c34-85aa-8a42b3540927]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:59:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-e8bb9cd3-df5b-4e20-ae08-1a42ae0a235d req-9a4ad38a-a1d1-4488-ad1c-bbec4bcae47b tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-e8bb9cd3-df5b-4e20-ae08-1a42ae0a235d req-9a4ad38a-a1d1-4488-ad1c-bbec4bcae47b tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4" returned: 0 in 0.448s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-e8bb9cd3-df5b-4e20-ae08-1a42ae0a235d req-9a4ad38a-a1d1-4488-ad1c-bbec4bcae47b tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.505s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:59:40 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-e8bb9cd3-df5b-4e20-ae08-1a42ae0a235d req-9a4ad38a-a1d1-4488-ad1c-bbec4bcae47b tempest-TestInstancesWithCinderVolumes-1832339358 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d33221b-b9a1-4f67-b99d-4ab3258f3b6b', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:59:40 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-e8bb9cd3-df5b-4e20-ae08-1a42ae0a235d req-9a4ad38a-a1d1-4488-ad1c-bbec4bcae47b tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:59:40 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-e8bb9cd3-df5b-4e20-ae08-1a42ae0a235d req-9a4ad38a-a1d1-4488-ad1c-bbec4bcae47b tempest-TestInstancesWithCinderVolumes-1832339358 None] attachment_update completed successfully.
Sep 17 19:59:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-61116482-13e1-4de1-9bb9-893f9973c7ae req-d4fe431b-0131-4bed-9643-2cf0bf4130dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:59:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-61116482-13e1-4de1-9bb9-893f9973c7ae req-d4fe431b-0131-4bed-9643-2cf0bf4130dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:59:50 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdfcf6a-4d71-4041-b5f2-905dc5305f57]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 19:59:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-61116482-13e1-4de1-9bb9-893f9973c7ae req-d4fe431b-0131-4bed-9643-2cf0bf4130dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [req-61116482-13e1-4de1-9bb9-893f9973c7ae req-d4fe431b-0131-4bed-9643-2cf0bf4130dd tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c" returned: 0 in 0.460s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [req-61116482-13e1-4de1-9bb9-893f9973c7ae req-d4fe431b-0131-4bed-9643-2cf0bf4130dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.507s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:59:51 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-61116482-13e1-4de1-9bb9-893f9973c7ae req-d4fe431b-0131-4bed-9643-2cf0bf4130dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b', 'name': 'volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c5b1713-4f68-4185-9e76-5407e790e64b', 'enforce_multipath': True} {{(pid=83122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 19:59:51 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-61116482-13e1-4de1-9bb9-893f9973c7ae req-d4fe431b-0131-4bed-9643-2cf0bf4130dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 19:59:51 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-61116482-13e1-4de1-9bb9-893f9973c7ae req-d4fe431b-0131-4bed-9643-2cf0bf4130dd tempest-TestInstancesWithCinderVolumes-1832339358 None] attachment_update completed successfully.
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.093s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 19:59:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:00:01 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:00:01 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:00:25 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-46b82c1e-77e8-473b-8d9a-18bd3c2aff6e req-9e0b3769-45e5-4305-a7a8-c32abbcaf86d tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:00:25 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-46b82c1e-77e8-473b-8d9a-18bd3c2aff6e req-9e0b3769-45e5-4305-a7a8-c32abbcaf86d tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:00:25 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-46b82c1e-77e8-473b-8d9a-18bd3c2aff6e req-9e0b3769-45e5-4305-a7a8-c32abbcaf86d tempest-TestInstancesWithCinderVolumes-1832339358 None] Terminate volume connection completed successfully.
Sep 17 20:00:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-46b82c1e-77e8-473b-8d9a-18bd3c2aff6e req-9e0b3769-45e5-4305-a7a8-c32abbcaf86d tempest-TestInstancesWithCinderVolumes-1832339358 None] Deleting attachment 9d33221b-b9a1-4f67-b99d-4ab3258f3b6b. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 20:00:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "cinder-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:00:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:00:27 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:00:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "cinder-quobyte-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:00:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-quobyte-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4" acquired by "delete_volume" :: waited 0.019s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:00:27 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a946662e-cab7-49c5-b98f-d54d4a29835d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:00:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:00:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4" returned: 0 in 0.508s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:00:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4" returned: 0 in 0.094s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-quobyte-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4" released by "delete_volume" :: held 0.788s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:00:28 devstack cinder-volume[83122]: WARNING cinder.quota [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-568101327-1380822431 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-568101327-1380822431, it is now deprecated. Please use the default quota class for default quota.
Sep 17 20:00:28 devstack cinder-volume[83122]: WARNING cinder.quota [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-568101327-1380822431 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-568101327-1380822431, it is now deprecated. Please use the default quota class for default quota.
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Created reservations ['9363b051-1dcb-4c39-9a3b-5a09feffa38d', 'c8f5fd21-b090-4903-be1f-0593b20ebbe2', '5705bee7-79cc-444b-aba1-602a8e58f929', '10af6fbb-c908-40db-ab53-97b7f5af3fae'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.087s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:00:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Deleted volume successfully.
Sep 17 20:00:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e344f8c1-5b83-4552-a130-55d2cdd9c4a3 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-bf43dbf0-d99d-4d78-8e49-94dd7b6f2fb4-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:00:38 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:00:38 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.087s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:00:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:00:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-9e5f7235-1000-4c57-9737-0094a6c42a23 req-5aeced64-99b7-4364-898d-993e0b04e6dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:00:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-9e5f7235-1000-4c57-9737-0094a6c42a23 req-5aeced64-99b7-4364-898d-993e0b04e6dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:00:55 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-9e5f7235-1000-4c57-9737-0094a6c42a23 req-5aeced64-99b7-4364-898d-993e0b04e6dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Terminate volume connection completed successfully.
Sep 17 20:00:55 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-9e5f7235-1000-4c57-9737-0094a6c42a23 req-5aeced64-99b7-4364-898d-993e0b04e6dd tempest-TestInstancesWithCinderVolumes-1832339358 None] Deleting attachment 5c5b1713-4f68-4185-9e76-5407e790e64b. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 20:00:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "cinder-fa736e0a-984a-4ba3-9b2c-7ddea332817c-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:00:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-fa736e0a-984a-4ba3-9b2c-7ddea332817c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:00:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:00:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "cinder-quobyte-fa736e0a-984a-4ba3-9b2c-7ddea332817c" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:00:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-quobyte-fa736e0a-984a-4ba3-9b2c-7ddea332817c" acquired by "delete_volume" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:00:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c656b8d7-a198-4bfa-b94e-56380eb3f261]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:00:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c" returned: 0 in 0.490s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-fa736e0a-984a-4ba3-9b2c-7ddea332817c" returned: 0 in 0.099s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-quobyte-fa736e0a-984a-4ba3-9b2c-7ddea332817c" released by "delete_volume" :: held 0.793s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:00:58 devstack cinder-volume[83122]: WARNING cinder.quota [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1716613908-851999995 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1716613908-851999995, it is now deprecated. Please use the default quota class for default quota.
Sep 17 20:00:58 devstack cinder-volume[83122]: WARNING cinder.quota [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1716613908-851999995 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1716613908-851999995, it is now deprecated. Please use the default quota class for default quota.
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Created reservations ['3783dc8e-c13a-400f-b86e-75932dfdac66', 'b5d35ee3-1203-469c-b2bb-73a0e627cdea', '8dbff4e7-fcdb-42b6-b639-440290bbf469', '18afac2a-d60f-4dd7-9064-49ac4a11db4c'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:00:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:00:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.121s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:00:59 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:00:59 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Deleted volume successfully.
Sep 17 20:00:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2fc8b875-1366-49ef-a4fe-75337fadd7fb tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-fa736e0a-984a-4ba3-9b2c-7ddea332817c-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:06 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-96b96201-13d5-449b-88dc-92c6e7c5e125 req-674debb5-470f-4098-9934-886144a7fb39 tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:06 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [req-96b96201-13d5-449b-88dc-92c6e7c5e125 req-674debb5-470f-4098-9934-886144a7fb39 tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:06 devstack cinder-volume[83122]: INFO cinder.volume.manager [req-96b96201-13d5-449b-88dc-92c6e7c5e125 req-674debb5-470f-4098-9934-886144a7fb39 tempest-TestInstancesWithCinderVolumes-1832339358 None] Terminate volume connection completed successfully.
Sep 17 20:01:06 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [req-96b96201-13d5-449b-88dc-92c6e7c5e125 req-674debb5-470f-4098-9934-886144a7fb39 tempest-TestInstancesWithCinderVolumes-1832339358 None] Deleting attachment 784bb682-d236-495d-b2d5-fdf64a850ea4. {{(pid=83122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 20:01:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "cinder-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "cinder-quobyte-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:09 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-quobyte-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:09 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7524a46-47d9-4e50-86ab-f6a081300117]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:01:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 0 in 0.412s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 1 in 0.369s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" returned: 0 in 0.110s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-quobyte-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2" released by "delete_volume" :: held 1.166s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:10 devstack cinder-volume[83122]: WARNING cinder.quota [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-831447097-716692433 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-831447097-716692433, it is now deprecated. Please use the default quota class for default quota.
Sep 17 20:01:10 devstack cinder-volume[83122]: WARNING cinder.quota [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-831447097-716692433 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-831447097-716692433, it is now deprecated. Please use the default quota class for default quota.
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Created reservations ['bc116c86-ae71-45da-86b9-cbda44095ec0', '191cb932-53b4-4333-9def-bf9b8c82fe15', '8ed7c5da-b6ad-457d-a2f0-50012ed4a314', '136edf36-392e-4f58-93a5-f0bfa47c5103'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.109s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:11 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:01:11 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Deleted volume successfully.
Sep 17 20:01:11 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-816900f3-2fb3-4ed2-870d-31d9de08a914 tempest-TestInstancesWithCinderVolumes-1832339358 None] Lock "cinder-3bf4fac2-21c7-4e11-bd16-ae6a52a414b2-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:20 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:01:21 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:01:26 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:26 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:01:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (c60ae804-aed6-4945-b301-2466add61d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba537bde-f40e-43ba-9d8f-a3d1d2f39ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba537bde-f40e-43ba-9d8f-a3d1d2f39ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-742529242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07a6439-7a40-429b-8512-70534c1d4f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:27Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603a3e69-7ff7-4c07-a415-ca62462b1fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603a3e69-7ff7-4c07-a415-ca62462b1fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eac5b09-7899-4f9a-9a85-7dc1d96ef303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eac5b09-7899-4f9a-9a85-7dc1d96ef303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f07a6439-7a40-429b-8512-70534c1d4f01', 'volume_name': 'volume-f07a6439-7a40-429b-8512-70534c1d4f01', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02375ee2-6b48-4876-acef-08807f7ba735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02375ee2-6b48-4876-acef-08807f7ba735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c5137d-be58-4250-9aa4-a5629e1f24d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:27 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume f07a6439-7a40-429b-8512-70534c1d4f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f07a6439-7a40-429b-8512-70534c1d4f01', 'volume_size': 1}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-742529242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07a6439-7a40-429b-8512-70534c1d4f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:27Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Creating volume f07a6439-7a40-429b-8512-70534c1d4f01 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:01:27 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f07a6439-7a40-429b-8512-70534c1d4f01 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:27 devstack quobyte-client[83143]: System call of process 101028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:01:27 devstack quobyte-client[83143]: System call of process 101028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:01:27 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=136, name=volume-f07a6439-7a40-429b-8512-70534c1d4f01, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f07a6439-7a40-429b-8512-70534c1d4f01 1073741824" returned: 0 in 0.314s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f07a6439-7a40-429b-8512-70534c1d4f01 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f07a6439-7a40-429b-8512-70534c1d4f01" returned: 0 in 0.090s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] <== create_volume: return (464ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.474s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c5137d-be58-4250-9aa4-a5629e1f24d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f07a6439-7a40-429b-8512-70534c1d4f01', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9221480-5788-4d64-95b7-d8ede47d4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:27 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume volume-f07a6439-7a40-429b-8512-70534c1d4f01 (f07a6439-7a40-429b-8512-70534c1d4f01): created successfully
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9221480-5788-4d64-95b7-d8ede47d4a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (c60ae804-aed6-4945-b301-2466add61d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:27 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f0ffc003-94c8-433f-a63e-5868a4ae6abd tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created volume successfully.
Sep 17 20:01:29 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (4c081c0a-ac27-4629-8b18-2ad19d4b759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77b83e6-f6b9-4d31-a233-4754e62d073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77b83e6-f6b9-4d31-a233-4754e62d073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-505514626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74247e43-4214-428c-a454-2648225e9780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:29Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc1138d-a2e2-47e0-a978-ee0ee96cd894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc1138d-a2e2-47e0-a978-ee0ee96cd894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea049ffd-c24c-4bc6-9892-aba662284fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea049ffd-c24c-4bc6-9892-aba662284fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74247e43-4214-428c-a454-2648225e9780', 'volume_name': 'volume-74247e43-4214-428c-a454-2648225e9780', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0da77e-b7fc-4ecd-b88e-367567d23d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0da77e-b7fc-4ecd-b88e-367567d23d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986522d0-e1c4-4c3e-9418-7edbc9246d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:29 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume 74247e43-4214-428c-a454-2648225e9780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74247e43-4214-428c-a454-2648225e9780', 'volume_size': 1}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-505514626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74247e43-4214-428c-a454-2648225e9780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:29Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Creating volume 74247e43-4214-428c-a454-2648225e9780 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:01:29 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:01:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74247e43-4214-428c-a454-2648225e9780 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:29 devstack quobyte-client[83143]: System call of process 101032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:01:29 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=137, name=volume-74247e43-4214-428c-a454-2648225e9780, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74247e43-4214-428c-a454-2648225e9780 1073741824" returned: 0 in 0.580s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74247e43-4214-428c-a454-2648225e9780 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:30 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (06e364bb-a92f-42c6-82db-97d331fe56d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51196e2-dcfb-4f76-952e-e689cbe61494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74247e43-4214-428c-a454-2648225e9780" returned: 0 in 0.585s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] <== create_volume: return (1218ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51196e2-dcfb-4f76-952e-e689cbe61494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-147568742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286e958d-191a-48df-934c-79acdcb38820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:30Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3834eb7-73a1-46f4-abef-e18f7c108fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3834eb7-73a1-46f4-abef-e18f7c108fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f74e9a-7f6e-4197-8bb7-3b665590a2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f74e9a-7f6e-4197-8bb7-3b665590a2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286e958d-191a-48df-934c-79acdcb38820', 'volume_name': 'volume-286e958d-191a-48df-934c-79acdcb38820', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e73c85-0bdd-4106-b2e4-6e103fb186e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e73c85-0bdd-4106-b2e4-6e103fb186e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd7f332-4221-4771-ac6a-38b9c6ccc5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:30 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume 286e958d-191a-48df-934c-79acdcb38820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286e958d-191a-48df-934c-79acdcb38820', 'volume_size': 1}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-147568742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286e958d-191a-48df-934c-79acdcb38820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:30Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Creating volume 286e958d-191a-48df-934c-79acdcb38820 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:01:30 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:01:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-286e958d-191a-48df-934c-79acdcb38820 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:31 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=138, name=volume-286e958d-191a-48df-934c-79acdcb38820, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:01:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (6ce584e7-fcba-46bb-a181-516584cb4eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307e637c-4e87-49d1-86cf-f3c52f0845e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307e637c-4e87-49d1-86cf-f3c52f0845e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1591440401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525c7356-b61d-4a49-80ad-8ca6d61c1c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:30Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f50e3a7-473f-48c3-8366-af2a673c0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f50e3a7-473f-48c3-8366-af2a673c0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d013185-8a4d-46fd-85b1-8cb3ebdda3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d013185-8a4d-46fd-85b1-8cb3ebdda3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525c7356-b61d-4a49-80ad-8ca6d61c1c2a', 'volume_name': 'volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a72e16-469a-4045-8ef0-63fe5abef1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a72e16-469a-4045-8ef0-63fe5abef1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c3e421-9d5d-4cab-a881-72aced60e6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:31 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume 525c7356-b61d-4a49-80ad-8ca6d61c1c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a', 'volume_size': 1}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986522d0-e1c4-4c3e-9418-7edbc9246d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74247e43-4214-428c-a454-2648225e9780', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a7f7b5-ac9b-4418-8118-7a1e36f2d243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-286e958d-191a-48df-934c-79acdcb38820 1073741824" returned: 0 in 0.669s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-286e958d-191a-48df-934c-79acdcb38820 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:31 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume volume-74247e43-4214-428c-a454-2648225e9780 (74247e43-4214-428c-a454-2648225e9780): created successfully
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a7f7b5-ac9b-4418-8118-7a1e36f2d243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (4c081c0a-ac27-4629-8b18-2ad19d4b759e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (aa5d23c1-a693-45d6-873e-5c8f243681ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6e2faf-b306-4d99-baad-7a16d83cc587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-91f4a458-6721-4e69-96aa-6c89ddcdc29e tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created volume successfully.
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-286e958d-191a-48df-934c-79acdcb38820" returned: 0 in 0.468s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] <== create_volume: return (1157ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1591440401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525c7356-b61d-4a49-80ad-8ca6d61c1c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:30Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Creating volume 525c7356-b61d-4a49-80ad-8ca6d61c1c2a {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:01:32 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:32 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:01:32 devstack quobyte-client[83143]: System call of process 101046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:01:32 devstack quobyte-client[83143]: System call of process 101046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:01:32 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=139, name=volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (3bc8acf8-b9be-4b4b-89fc-fc76408b26ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13842a9-1831-4d6c-b5af-52f089db6de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6e2faf-b306-4d99-baad-7a16d83cc587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-236392839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9868f4-6e4f-4a43-9917-13374e179ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:31Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3c60e9-4ae1-4bd5-a9d9-4f398c29ad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3c60e9-4ae1-4bd5-a9d9-4f398c29ad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74296be9-3544-4266-919a-68fe66b9d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74296be9-3544-4266-919a-68fe66b9d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9868f4-6e4f-4a43-9917-13374e179ba7', 'volume_name': 'volume-af9868f4-6e4f-4a43-9917-13374e179ba7', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0e4283-209d-465b-becb-e47e7439f030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0e4283-209d-465b-becb-e47e7439f030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d97e404-dae5-4787-92e7-4b3e06b5dd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume af9868f4-6e4f-4a43-9917-13374e179ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9868f4-6e4f-4a43-9917-13374e179ba7', 'volume_size': 1}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd7f332-4221-4771-ac6a-38b9c6ccc5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286e958d-191a-48df-934c-79acdcb38820', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0c54aa-8d36-4be2-9ed5-9cece1e89d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13842a9-1831-4d6c-b5af-52f089db6de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1471005891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8861b6ef-3ad9-4ceb-8106-8ed81616a932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:31Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d006766a-9849-4d75-9c7b-5d7fd0930bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d006766a-9849-4d75-9c7b-5d7fd0930bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b617ca-01fc-4f00-baba-c64d9670c0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b617ca-01fc-4f00-baba-c64d9670c0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8861b6ef-3ad9-4ceb-8106-8ed81616a932', 'volume_name': 'volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b5e3ea-8ce4-46fe-9fee-ddb7eb1bf41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b5e3ea-8ce4-46fe-9fee-ddb7eb1bf41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6893cdab-7af3-4525-ba76-104e66c0e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:32 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume 8861b6ef-3ad9-4ceb-8106-8ed81616a932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932', 'volume_size': 1}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a 1073741824" returned: 0 in 0.596s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:32 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume volume-286e958d-191a-48df-934c-79acdcb38820 (286e958d-191a-48df-934c-79acdcb38820): created successfully
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0c54aa-8d36-4be2-9ed5-9cece1e89d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (06e364bb-a92f-42c6-82db-97d331fe56d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a" returned: 0 in 0.318s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] <== create_volume: return (935ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:01:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-236392839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9868f4-6e4f-4a43-9917-13374e179ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:31Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Creating volume af9868f4-6e4f-4a43-9917-13374e179ba7 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:01:33 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-af9868f4-6e4f-4a43-9917-13374e179ba7 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:33 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=140, name=volume-af9868f4-6e4f-4a43-9917-13374e179ba7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:01:33 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d32d01c7-d138-49eb-a7c2-2ad7cdb37f4d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created volume successfully.
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c3e421-9d5d-4cab-a881-72aced60e6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9ec65f-6a56-406c-898d-3386978706a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-af9868f4-6e4f-4a43-9917-13374e179ba7 1073741824" returned: 0 in 0.425s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-af9868f4-6e4f-4a43-9917-13374e179ba7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-af9868f4-6e4f-4a43-9917-13374e179ba7" returned: 0 in 0.211s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] <== create_volume: return (682ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.101s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1471005891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8861b6ef-3ad9-4ceb-8106-8ed81616a932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800381d4baef469f9292779e235bc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:01:31Z,use_quota=True,user_id='4d4691bd3f184ecaab85c29971c4da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Creating volume 8861b6ef-3ad9-4ceb-8106-8ed81616a932 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:01:33 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:01:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:33 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=141, name=volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d97e404-dae5-4787-92e7-4b3e06b5dd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9868f4-6e4f-4a43-9917-13374e179ba7', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e0118a-f743-47de-a37b-658ce519e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:34 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a (525c7356-b61d-4a49-80ad-8ca6d61c1c2a): created successfully
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9ec65f-6a56-406c-898d-3386978706a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (6ce584e7-fcba-46bb-a181-516584cb4eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932 1073741824" returned: 0 in 0.433s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:34 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-98d55727-b8fd-4ac9-a7b2-81694468b27d tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created volume successfully.
Sep 17 20:01:34 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume volume-af9868f4-6e4f-4a43-9917-13374e179ba7 (af9868f4-6e4f-4a43-9917-13374e179ba7): created successfully
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e0118a-f743-47de-a37b-658ce519e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (aa5d23c1-a693-45d6-873e-5c8f243681ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932" returned: 0 in 0.328s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] <== create_volume: return (791ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:34 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-07513821-a95f-454c-aee2-c83edc9e0e39 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created volume successfully.
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6893cdab-7af3-4525-ba76-104e66c0e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70caa26d-3e62-43d8-91ef-cbc9cab4d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:01:34 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932 (8861b6ef-3ad9-4ceb-8106-8ed81616a932): created successfully
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70caa26d-3e62-43d8-91ef-cbc9cab4d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:01:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Flow 'volume_create_manager' (3bc8acf8-b9be-4b4b-89fc-fc76408b26ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:01:34 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f7e049f5-a7a6-4d12-9577-17f99693c688 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created volume successfully.
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-8861b6ef-3ad9-4ceb-8106-8ed81616a932-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-8861b6ef-3ad9-4ceb-8106-8ed81616a932-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:35 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-quobyte-8861b6ef-3ad9-4ceb-8106-8ed81616a932" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-8861b6ef-3ad9-4ceb-8106-8ed81616a932" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd453f0d-890d-4ff7-ac1b-3a0ab1f3abb6]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932" returned: 0 in 0.415s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8861b6ef-3ad9-4ceb-8106-8ed81616a932" returned: 0 in 0.085s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-8861b6ef-3ad9-4ceb-8106-8ed81616a932" released by "delete_volume" :: held 0.641s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created reservations ['c484cfd6-7538-4f7c-b534-32fb89489d98', '6c9b5696-fa99-4e9f-92ce-eee39f2e8c6d', 'e9d13b29-60d9-4ef9-a1e1-47648cebba61', 'cd953bd9-382b-4425-bb64-0aafb785947b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.277s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:01:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Deleted volume successfully.
Sep 17 20:01:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-84e620bd-3cb2-4afe-9d91-d172b52c61ac tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-8861b6ef-3ad9-4ceb-8106-8ed81616a932-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-af9868f4-6e4f-4a43-9917-13374e179ba7-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-af9868f4-6e4f-4a43-9917-13374e179ba7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:37 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-quobyte-af9868f4-6e4f-4a43-9917-13374e179ba7" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-af9868f4-6e4f-4a43-9917-13374e179ba7" acquired by "delete_volume" :: waited 0.012s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:37 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99246f0-9dd9-455b-9332-859bbb5c8d9c]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:01:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-af9868f4-6e4f-4a43-9917-13374e179ba7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-af9868f4-6e4f-4a43-9917-13374e179ba7" returned: 0 in 0.424s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-af9868f4-6e4f-4a43-9917-13374e179ba7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-af9868f4-6e4f-4a43-9917-13374e179ba7" returned: 0 in 0.087s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-af9868f4-6e4f-4a43-9917-13374e179ba7" released by "delete_volume" :: held 0.671s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created reservations ['7b2bbf61-2bab-4aee-bb96-242dc06573ce', '8d037a21-7c1e-400b-b252-e4b89d6170fa', '1a6eece1-6da1-4d03-9912-21c22b965d6c', 'ebe65b72-5e7f-4310-b4f6-233dd1752e07'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.098s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:38 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:01:38 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Deleted volume successfully.
Sep 17 20:01:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-278787ed-c151-4b6c-9dfd-76ffad9ee05f tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-af9868f4-6e4f-4a43-9917-13374e179ba7-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-525c7356-b61d-4a49-80ad-8ca6d61c1c2a-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-525c7356-b61d-4a49-80ad-8ca6d61c1c2a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:39 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-quobyte-525c7356-b61d-4a49-80ad-8ca6d61c1c2a" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-525c7356-b61d-4a49-80ad-8ca6d61c1c2a" acquired by "delete_volume" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:40 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ba48f0-5779-4122-bc51-7bdcd9ea0d3a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:01:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a" returned: 0 in 0.386s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-525c7356-b61d-4a49-80ad-8ca6d61c1c2a" returned: 0 in 0.115s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-525c7356-b61d-4a49-80ad-8ca6d61c1c2a" released by "delete_volume" :: held 0.639s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:40 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created reservations ['3bafa516-dfed-4b42-a168-6edf55f937f2', '89aa01ed-2354-4b15-95fe-0ae019fbee2f', '38a2e70c-2f36-46b8-8431-4d9990a1a0bf', '4146432f-eeeb-49e3-8e4a-42858aafe16a'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.109s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:01:41 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Deleted volume successfully.
Sep 17 20:01:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3809a95c-5bc6-4a86-9d96-33472b04c00b tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-525c7356-b61d-4a49-80ad-8ca6d61c1c2a-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-286e958d-191a-48df-934c-79acdcb38820-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-286e958d-191a-48df-934c-79acdcb38820-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:42 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-quobyte-286e958d-191a-48df-934c-79acdcb38820" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-286e958d-191a-48df-934c-79acdcb38820" acquired by "delete_volume" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb37ea1-da2d-4562-abb2-9601e702170a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-286e958d-191a-48df-934c-79acdcb38820 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-286e958d-191a-48df-934c-79acdcb38820" returned: 0 in 0.390s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-286e958d-191a-48df-934c-79acdcb38820 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-286e958d-191a-48df-934c-79acdcb38820" returned: 0 in 0.091s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-286e958d-191a-48df-934c-79acdcb38820" released by "delete_volume" :: held 0.643s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created reservations ['7ea75357-8008-462e-8c6e-02efee7fcfad', '3e661b79-e882-44c2-99ff-b761c851fdd5', '9cfdedaf-2175-40d4-bbfe-f3959a7bddf3', '85367a91-b1e4-4c6d-a8c1-39d699e18f45'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.095s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:01:43 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Deleted volume successfully.
Sep 17 20:01:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d8da10bf-4a89-4ed7-a2d9-a372ea7c62cc tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-286e958d-191a-48df-934c-79acdcb38820-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-74247e43-4214-428c-a454-2648225e9780-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-74247e43-4214-428c-a454-2648225e9780-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:44 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-quobyte-74247e43-4214-428c-a454-2648225e9780" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-74247e43-4214-428c-a454-2648225e9780" acquired by "delete_volume" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:44 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed3827-5b6c-4ff1-ad83-b1e0234e0d96]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:01:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74247e43-4214-428c-a454-2648225e9780 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74247e43-4214-428c-a454-2648225e9780" returned: 0 in 0.392s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74247e43-4214-428c-a454-2648225e9780 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-74247e43-4214-428c-a454-2648225e9780" returned: 0 in 0.089s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-74247e43-4214-428c-a454-2648225e9780" released by "delete_volume" :: held 0.628s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created reservations ['00efcd99-5e87-4594-b0e0-8afbeb40c303', '6105da4a-20c1-4a2a-9d6c-6d3b4826f35f', 'ea961226-40c0-46d4-a044-9b9544e5d0b7', '36efbdc4-8878-4169-90eb-1eb117cfafef'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.092s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:45 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:01:45 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Deleted volume successfully.
Sep 17 20:01:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-a29bbba1-2617-4430-872b-742ef7fbd6e1 tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-74247e43-4214-428c-a454-2648225e9780-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-f07a6439-7a40-429b-8512-70534c1d4f01-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-f07a6439-7a40-429b-8512-70534c1d4f01-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:01:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "cinder-quobyte-f07a6439-7a40-429b-8512-70534c1d4f01" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:01:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-f07a6439-7a40-429b-8512-70534c1d4f01" acquired by "delete_volume" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:01:46 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec1935-d9ba-4abb-bf69-978795e70b01]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:01:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f07a6439-7a40-429b-8512-70534c1d4f01 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f07a6439-7a40-429b-8512-70534c1d4f01" returned: 0 in 0.390s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f07a6439-7a40-429b-8512-70534c1d4f01 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f07a6439-7a40-429b-8512-70534c1d4f01" returned: 0 in 0.127s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-quobyte-f07a6439-7a40-429b-8512-70534c1d4f01" released by "delete_volume" :: held 0.672s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Created reservations ['13270e16-f0da-49b4-8ac2-0dd237e2d1de', 'e641a445-349b-4f51-8bea-89610cf1d7cb', '4dbb8cda-c5c6-4a87-821b-4b5050deab26', '969cfa3b-3d5e-491e-ace9-d94b4fa4a3f9'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.087s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:48 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:01:48 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Deleted volume successfully.
Sep 17 20:01:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24aef95a-a44e-4611-a198-3fcb02130bfe tempest-CreateVolumesFromSourceVolumeTest-1756060795 None] Lock "cinder-f07a6439-7a40-429b-8512-70534c1d4f01-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.105s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:01:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:01:57 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=42,cinder:UPDATE=57,cinder:DELETE=5,cinder:INSERT=18 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:01:58 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=31,cinder:UPDATE=64,cinder:DELETE=7,cinder:INSERT=6 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:02:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:02:17 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:02:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Flow 'volume_create_manager' (f486f5ba-1bc0-4ed8-a3f6-c666eabd124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:02:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83df97e9-9a2c-4b07-8c1d-edaf9b3cad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83df97e9-9a2c-4b07-8c1d-edaf9b3cad51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-724040059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bfda40-3cf3-4ed7-b61b-cc7881c0932c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a521ca08c3a4b0484482492fcb431b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:02:18Z,use_quota=True,user_id='0e7390206e5d4cb3a8358cdf63236a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ff76d1-9e38-43d7-a2eb-cbfd3d0772a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ff76d1-9e38-43d7-a2eb-cbfd3d0772a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37babf3-2331-4079-bc42-4b198b7e79b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37babf3-2331-4079-bc42-4b198b7e79b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4bfda40-3cf3-4ed7-b61b-cc7881c0932c', 'volume_name': 'volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb91e07b-3479-4321-8ad8-98d6350013e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb91e07b-3479-4321-8ad8-98d6350013e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98bf8aa-b41b-47a0-85d2-140878a1cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Volume e4bfda40-3cf3-4ed7-b61b-cc7881c0932c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c', 'volume_size': 1}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-724040059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bfda40-3cf3-4ed7-b61b-cc7881c0932c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a521ca08c3a4b0484482492fcb431b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:02:18Z,use_quota=True,user_id='0e7390206e5d4cb3a8358cdf63236a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Creating volume e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:02:18 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:18 devstack quobyte-client[83143]: System call of process 101131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:02:18 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=142, name=volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c 1073741824" returned: 0 in 0.342s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" returned: 0 in 0.112s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] <== create_volume: return (532ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.546s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98bf8aa-b41b-47a0-85d2-140878a1cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b135d7bc-9b6b-4a22-9585-b7d5733e90c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:18 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Volume volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c (e4bfda40-3cf3-4ed7-b61b-cc7881c0932c): created successfully
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b135d7bc-9b6b-4a22-9585-b7d5733e90c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:18 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Flow 'volume_create_manager' (f486f5ba-1bc0-4ed8-a3f6-c666eabd124f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:02:18 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c66f4d7e-9fb5-4f22-9c8c-8ac6c99a1318 tempest-SnapshotDependencyTests-1448376487 None] Created volume successfully.
Sep 17 20:02:20 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:02:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Creating offline snapshot d941b350-1610-47dc-9976-a688c0f30da4 of volume e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 20:02:20 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b89445-78dc-49eb-9cff-63f5a838b4ea]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:02:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" returned: 0 in 0.485s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:20 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=143, name=volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 1G" returned: 0 in 0.225s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] CMD "qemu-img rebase -u -b volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4" returned: 0 in 0.158s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4" returned: 0 in 0.109s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4" returned: 0 in 0.092s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.info" returned: 0 in 0.102s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.info" returned: 0 in 0.086s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.577s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1e1b6633-f4cd-4703-a8fb-fc1158ee95da tempest-SnapshotDependencyTests-1448376487 None] Create snapshot completed successfully
Sep 17 20:02:22 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Flow 'volume_create_manager' (468126ee-9b62-4141-ac90-52c364652720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d66086-840c-4c6b-a2c5-892bd8fcb43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d66086-840c-4c6b-a2c5-892bd8fcb43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a18ccb-98b0-4fd5-81be-21d3d30ae633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a521ca08c3a4b0484482492fcb431b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d941b350-1610-47dc-9976-a688c0f30da4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:02:23Z,use_quota=True,user_id='0e7390206e5d4cb3a8358cdf63236a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0751bfc9-aca2-408f-bdc3-3c1bdff239d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0751bfc9-aca2-408f-bdc3-3c1bdff239d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d667a58f-c7c9-4873-888e-5c9c610ba181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d667a58f-c7c9-4873-888e-5c9c610ba181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86a18ccb-98b0-4fd5-81be-21d3d30ae633', 'volume_name': 'volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633', 'volume_size': 1, 'snapshot_id': 'd941b350-1610-47dc-9976-a688c0f30da4'}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4eb9ec-8476-456e-854f-b31b9916ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4eb9ec-8476-456e-854f-b31b9916ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14686394-eb8e-4210-a55f-1dc39c8a8c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:23 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Volume 86a18ccb-98b0-4fd5-81be-21d3d30ae633: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633', 'volume_size': 1, 'snapshot_id': 'd941b350-1610-47dc-9976-a688c0f30da4'}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-quobyte-d941b350-1610-47dc-9976-a688c0f30da4-86a18ccb-98b0-4fd5-81be-21d3d30ae633" by "_create_volume_from_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-d941b350-1610-47dc-9976-a688c0f30da4-86a18ccb-98b0-4fd5-81be-21d3d30ae633" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Creating volume 86a18ccb-98b0-4fd5-81be-21d3d30ae633 from snapshot d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-quobyte-86a18ccb-98b0-4fd5-81be-21d3d30ae633" by "_copy_volume_from_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-86a18ccb-98b0-4fd5-81be-21d3d30ae633" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] snapshot: d941b350-1610-47dc-9976-a688c0f30da4, volume: 86a18ccb-98b0-4fd5-81be-21d3d30ae633,  {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16160aa7-8d35-4eaa-8546-6ea7311aa011]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4" returned: 0 in 0.398s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Creating direct copy from snapshot {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d17444-3085-484a-99ed-096da443a3a6]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:02:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" returned: 0 in 0.438s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:24 devstack cinder-volume[83122]: DEBUG cinder.utils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633 not found in is_blk_device check {{(pid=83122) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 20:02:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:24 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=145, name=volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:02:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633" returned: 0 in 5.444s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:29 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35fe903-1f26-4408-a8a6-302448473c5f]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:02:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" returned: 0 in 0.572s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633 {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 20:02:30 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Converted 1024.00 MB image at 186.99 MB/s
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633" returned: 0 in 0.116s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-86a18ccb-98b0-4fd5-81be-21d3d30ae633" released by "_copy_volume_from_snapshot" :: held 7.355s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-d941b350-1610-47dc-9976-a688c0f30da4-86a18ccb-98b0-4fd5-81be-21d3d30ae633" released by "_create_volume_from_snapshot" :: held 7.391s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.411s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14686394-eb8e-4210-a55f-1dc39c8a8c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633', 'volume_size': 1, 'snapshot_id': 'd941b350-1610-47dc-9976-a688c0f30da4'}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6577338-0794-450f-be89-9dfdaa9cb200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:02:30 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Volume volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633 (86a18ccb-98b0-4fd5-81be-21d3d30ae633): created successfully
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6577338-0794-450f-be89-9dfdaa9cb200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:02:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Flow 'volume_create_manager' (468126ee-9b62-4141-ac90-52c364652720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:02:31 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b9ba3797-864d-4e21-81ec-bfade58170a4 tempest-SnapshotDependencyTests-1448376487 None] Created volume successfully.
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-d941b350-1610-47dc-9976-a688c0f30da4-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-d941b350-1610-47dc-9976-a688c0f30da4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:32 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-quobyte-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-quobyte-d941b350-1610-47dc-9976-a688c0f30da4" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-d941b350-1610-47dc-9976-a688c0f30da4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Deleting offline snapshot d941b350-1610-47dc-9976-a688c0f30da4 of volume e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] snapshot_file for this snap is: volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b899a00b-884e-460b-8848-d362c766153b]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4" returned: 0 in 0.385s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbb6b22-9a7c-4355-b33a-5c8b20f39127]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:02:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" returned: 0 in 0.409s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:33 devstack quobyte-client[83143]: System call of process 101181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:02:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4" returned: 0 in 0.212s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c.d941b350-1610-47dc-9976-a688c0f30da4" returned: 0 in 0.095s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-d941b350-1610-47dc-9976-a688c0f30da4" released by "_delete_snapshot" :: held 1.403s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" released by "delete_snapshot" :: held 1.433s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:33 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Created reservations ['4677a493-ce6e-4d80-bddd-5052b9f38619', '78bfc130-c60e-4b2a-9996-b4a4a149986a', 'dbec352c-e016-4c36-b43a-d53961df9c22', 'ac4d3628-d31b-4f26-9f44-b5c7269972a7'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:02:34 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Delete snapshot completed successfully.
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-61cf25f5-eb50-465a-8af7-ad24e338bd50 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-d941b350-1610-47dc-9976-a688c0f30da4-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:34 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-quobyte-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" acquired by "delete_volume" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03bbe12-540f-41aa-ba0c-726f6013ff8a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" returned: 0 in 0.394s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" returned: 0 in 0.119s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c" released by "delete_volume" :: held 0.679s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Created reservations ['f2d9dd82-b666-406d-897f-4143e0cd194e', 'b9378ced-ebcf-4939-a900-f8a85de68072', '0b37965f-8ce0-4e7e-b548-7cce9993f7a8', 'a0df8646-e818-4065-aa6a-3312a053d622'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.104s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:02:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Deleted volume successfully.
Sep 17 20:02:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-3223c4e6-535a-4c80-909f-e7bae2dcf0d1 tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-e4bfda40-3cf3-4ed7-b61b-cc7881c0932c-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-86a18ccb-98b0-4fd5-81be-21d3d30ae633-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-86a18ccb-98b0-4fd5-81be-21d3d30ae633-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:36 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:02:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "cinder-quobyte-86a18ccb-98b0-4fd5-81be-21d3d30ae633" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:02:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-86a18ccb-98b0-4fd5-81be-21d3d30ae633" acquired by "delete_volume" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:02:36 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[207057ee-49d2-4b18-a63f-67605f2d4095]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:02:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633" returned: 0 in 0.384s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-86a18ccb-98b0-4fd5-81be-21d3d30ae633" returned: 0 in 0.116s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-quobyte-86a18ccb-98b0-4fd5-81be-21d3d30ae633" released by "delete_volume" :: held 0.654s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Created reservations ['7c65e969-872f-4b26-bc8b-2649c9279d91', 'de4c59d9-c6ea-4793-8a42-4abd3d843186', '1111c87d-677c-49f8-ae75-723ea596d425', 'be5bd2c0-cb73-41ed-94a9-7d7e91296866'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.128s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:38 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:02:38 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Deleted volume successfully.
Sep 17 20:02:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-e456dd27-845d-4c8a-be48-7fccbeecd6ee tempest-SnapshotDependencyTests-1448376487 None] Lock "cinder-86a18ccb-98b0-4fd5-81be-21d3d30ae633-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:02:47 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=16,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:02:48 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=31,cinder:DELETE=4,cinder:SELECT=23,cinder:INSERT=7 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.133s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:02:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:08 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (451e5017-b344-4161-a339-cdd890f96f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b3ada2-74f6-4f98-9e5e-cf4cbde91440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b3ada2-74f6-4f98-9e5e-cf4cbde91440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486563393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:08Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf26a64-5cef-4f9d-ac41-d57fac969b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf26a64-5cef-4f9d-ac41-d57fac969b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b633c97f-71eb-45d5-b290-b5117e1ad8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b633c97f-71eb-45d5-b290-b5117e1ad8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7', 'volume_name': 'volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd092176-8d49-41a2-89cc-b47d470d0926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd092176-8d49-41a2-89cc-b47d470d0926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e66671-e75b-485b-9f0c-42c3462cbf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:08 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume 7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7', 'volume_size': 1}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486563393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:08Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Creating volume 7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:08 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:08 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:08 devstack quobyte-client[83143]: System call of process 101286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:08 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=146, name=volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (f9293a67-3f54-4bf7-b54b-5bc8c7bd7e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:08 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c531031-c864-4e9e-a220-56b8c168da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c531031-c864-4e9e-a220-56b8c168da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-38907806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f470935-6c3a-4cfe-8d19-dfde401dd52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:08Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29622e9-5aec-48c4-9fe0-b3a4978347d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29622e9-5aec-48c4-9fe0-b3a4978347d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bb5926-dd2c-4a9c-83fe-93faa68a5467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bb5926-dd2c-4a9c-83fe-93faa68a5467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f470935-6c3a-4cfe-8d19-dfde401dd52f', 'volume_name': 'volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cabd2ec-3744-419a-9304-9ec6293f7e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cabd2ec-3744-419a-9304-9ec6293f7e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c35e6f1-b98c-4dda-bab8-db553b6f4a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume 3f470935-6c3a-4cfe-8d19-dfde401dd52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f', 'volume_size': 1}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 1073741824" returned: 0 in 0.783s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (d4f40936-0049-4816-8f8a-db5cd9a4144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa4114e-fc9b-4401-bc73-f22ead652e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (57201117-ee05-4275-b399-97a78df675f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5bae9d-13d8-4cc5-8e6d-50db5721befa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa4114e-fc9b-4401-bc73-f22ead652e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439476519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0eaac1e-39cd-473d-a08f-3cd3d6aa3528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:09Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ecbe9b-88b0-4462-abeb-da2457bae2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ecbe9b-88b0-4462-abeb-da2457bae2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fe5a93-55d1-48f5-b400-fca77a4071a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fe5a93-55d1-48f5-b400-fca77a4071a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0eaac1e-39cd-473d-a08f-3cd3d6aa3528', 'volume_name': 'volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdad10c8-5988-4057-bfc1-06c23f58b997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdad10c8-5988-4057-bfc1-06c23f58b997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc736795-8702-4434-814b-d1bbc2e2a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:09 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Volume f0eaac1e-39cd-473d-a08f-3cd3d6aa3528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528', 'volume_size': 1}
Sep 17 20:03:09 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" returned: 0 in 0.619s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5bae9d-13d8-4cc5-8e6d-50db5721befa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1916832988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5501fb7-b6d3-4732-beb5-e7ac708468c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:09Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03721e66-a1ea-4890-be62-b40974e8e38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03721e66-a1ea-4890-be62-b40974e8e38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e367a5d-6979-4499-a35e-3f3c00aaaef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e367a5d-6979-4499-a35e-3f3c00aaaef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5501fb7-b6d3-4732-beb5-e7ac708468c8', 'volume_name': 'volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13f018c-3d4f-4156-8428-2f44888b45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13f018c-3d4f-4156-8428-2f44888b45e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c868c01-5703-46ad-a9dc-ac79f74153c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Volume d5501fb7-b6d3-4732-beb5-e7ac708468c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8', 'volume_size': 1}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] <== create_volume: return (1474ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-38907806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f470935-6c3a-4cfe-8d19-dfde401dd52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:08Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Creating volume 3f470935-6c3a-4cfe-8d19-dfde401dd52f {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:10 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:10 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=147, name=volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e66671-e75b-485b-9f0c-42c3462cbf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0252cf6c-1a2c-4b73-a72b-c3a6aeb35780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (c94a8092-d96d-40b5-8d74-568c066e8a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f519b6e-f981-4b4f-b8f9-e2a28a80f561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f519b6e-f981-4b4f-b8f9-e2a28a80f561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1774009697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ace263a-1fb7-43fa-9861-27fba96bec88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:10Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5c9c3a-5e67-4a25-a112-fb09a589daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5c9c3a-5e67-4a25-a112-fb09a589daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8970f75-a688-461e-ab5d-771da352680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8970f75-a688-461e-ab5d-771da352680d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ace263a-1fb7-43fa-9861-27fba96bec88', 'volume_name': 'volume-0ace263a-1fb7-43fa-9861-27fba96bec88', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67225839-bc90-477c-badc-0fca1f331735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67225839-bc90-477c-badc-0fca1f331735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74813b9c-3e70-45fa-8bdd-a9264b37c5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:10 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Volume 0ace263a-1fb7-43fa-9861-27fba96bec88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ace263a-1fb7-43fa-9861-27fba96bec88', 'volume_size': 1}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:10 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 (7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7): created successfully
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0252cf6c-1a2c-4b73-a72b-c3a6aeb35780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (451e5017-b344-4161-a339-cdd890f96f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f 1073741824" returned: 0 in 0.710s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:10 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:11 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-245f2d86-d40b-491d-a260-8e1eeeff5936 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created volume successfully.
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f" returned: 0 in 0.411s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] <== create_volume: return (1145ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.279s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439476519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0eaac1e-39cd-473d-a08f-3cd3d6aa3528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:09Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Creating volume f0eaac1e-39cd-473d-a08f-3cd3d6aa3528 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:11 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:11 devstack quobyte-client[83143]: System call of process 101294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:11 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=148, name=volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c35e6f1-b98c-4dda-bab8-db553b6f4a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0a8e40-e131-401b-a48d-de7c2385beb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:11 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (f2af8dc2-e0ad-4f37-bfd0-1e3a9c6e4a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdda3978-1ae1-462c-99e5-2258dbcd9256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdda3978-1ae1-462c-99e5-2258dbcd9256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051224460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ac8c7a-9443-46b1-a465-2a40db7a1911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:11Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3316208-b823-4043-9cfe-3b056bf0b9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3316208-b823-4043-9cfe-3b056bf0b9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df8f878-420a-4c7f-9835-1debf29eb48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df8f878-420a-4c7f-9835-1debf29eb48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ac8c7a-9443-46b1-a465-2a40db7a1911', 'volume_name': 'volume-23ac8c7a-9443-46b1-a465-2a40db7a1911', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af97af2a-1ff0-4365-9faf-b00a3ad09186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af97af2a-1ff0-4365-9faf-b00a3ad09186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3671e5a-184a-400d-8327-b1ceb696be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:11 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Volume 23ac8c7a-9443-46b1-a465-2a40db7a1911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ac8c7a-9443-46b1-a465-2a40db7a1911', 'volume_size': 1}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528 1073741824" returned: 0 in 0.664s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:12 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f (3f470935-6c3a-4cfe-8d19-dfde401dd52f): created successfully
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0a8e40-e131-401b-a48d-de7c2385beb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (f9293a67-3f54-4bf7-b54b-5bc8c7bd7e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (444fc03f-5deb-4980-b826-1e72fc36f58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9d5931-7b52-4a59-8f0b-b50fcea5ff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:12 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4c79eebd-867d-4b0c-ae95-0964fd173cc8 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created volume successfully.
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528" returned: 0 in 0.547s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] <== create_volume: return (1259ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.527s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1916832988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5501fb7-b6d3-4732-beb5-e7ac708468c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:09Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Creating volume d5501fb7-b6d3-4732-beb5-e7ac708468c8 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:12 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:12 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=149, name=volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc736795-8702-4434-814b-d1bbc2e2a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98837715-3b78-427b-a39d-4170db72b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9d5931-7b52-4a59-8f0b-b50fcea5ff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-538786215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:11Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4b45be-eb85-475f-8514-ddc951e85c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4b45be-eb85-475f-8514-ddc951e85c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27af8c1-0237-4884-906b-2940d439a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27af8c1-0237-4884-906b-2940d439a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb', 'volume_name': 'volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244c888d-eb19-481a-853c-0a6154625d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244c888d-eb19-481a-853c-0a6154625d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c2343b-b6fb-4a23-9695-f3b5977e89a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:13 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Volume c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb', 'volume_size': 1}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:13 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Volume volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528 (f0eaac1e-39cd-473d-a08f-3cd3d6aa3528): created successfully
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98837715-3b78-427b-a39d-4170db72b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (d4f40936-0049-4816-8f8a-db5cd9a4144e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8 1073741824" returned: 0 in 0.655s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:13 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-1fcdda17-36b7-4290-887c-9b10176f91c4 tempest-CreateVolumesFromImageTest-909639783 None] Created volume successfully.
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8" returned: 0 in 0.682s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] <== create_volume: return (1362ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.182s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1774009697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ace263a-1fb7-43fa-9861-27fba96bec88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:10Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Creating volume 0ace263a-1fb7-43fa-9861-27fba96bec88 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:13 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:13 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:14 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0ace263a-1fb7-43fa-9861-27fba96bec88 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:14 devstack quobyte-client[83143]: System call of process 101303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:14 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=150, name=volume-0ace263a-1fb7-43fa-9861-27fba96bec88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c868c01-5703-46ad-a9dc-ac79f74153c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d980259-53ec-4157-9229-54898019f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:14 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:14 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (20bec159-657d-445c-93d7-3f5b07d492bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e3fa9e-1415-4894-b02f-9dc49085ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e3fa9e-1415-4894-b02f-9dc49085ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2032924848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d113cf-79f4-4fb5-8760-14098dd01f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:14Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa2d3ec-c7cd-46bd-83db-3f1c753bc11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa2d3ec-c7cd-46bd-83db-3f1c753bc11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a65f93c-bd8b-4c62-9eb4-1f3a002e316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a65f93c-bd8b-4c62-9eb4-1f3a002e316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d113cf-79f4-4fb5-8760-14098dd01f76', 'volume_name': 'volume-07d113cf-79f4-4fb5-8760-14098dd01f76', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1720f165-4ba0-477a-94b0-a78b8d501fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1720f165-4ba0-477a-94b0-a78b8d501fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8389ea43-9ca8-46b8-9100-81f1a89c2b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume 07d113cf-79f4-4fb5-8760-14098dd01f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d113cf-79f4-4fb5-8760-14098dd01f76', 'volume_size': 1}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0ace263a-1fb7-43fa-9861-27fba96bec88 1073741824" returned: 0 in 1.087s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0ace263a-1fb7-43fa-9861-27fba96bec88 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Volume volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8 (d5501fb7-b6d3-4732-beb5-e7ac708468c8): created successfully
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d980259-53ec-4157-9229-54898019f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (57201117-ee05-4275-b399-97a78df675f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:15 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-72e83e69-5db6-45fd-9382-b0924893a5bf tempest-CreateVolumesFromImageTest-909639783 None] Created volume successfully.
Sep 17 20:03:15 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (2261c5c1-177d-49ac-9711-4c38b06cb17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb4fc9c-3172-4e99-b0de-c2b07ef1c0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0ace263a-1fb7-43fa-9861-27fba96bec88" returned: 0 in 0.884s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb4fc9c-3172-4e99-b0de-c2b07ef1c0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1384043245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16114985-bb61-46d5-b60b-ec5c762f4367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:14Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cce231-9717-445b-a79a-d17d927c9109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cce231-9717-445b-a79a-d17d927c9109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfb5dd5-3ca3-4ea8-b549-f3a1cffd588f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfb5dd5-3ca3-4ea8-b549-f3a1cffd588f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16114985-bb61-46d5-b60b-ec5c762f4367', 'volume_name': 'volume-16114985-bb61-46d5-b60b-ec5c762f4367', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06c7e5b-9889-4f80-ac2d-2a93c6c3116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06c7e5b-9889-4f80-ac2d-2a93c6c3116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df80eadc-c5e6-45f5-860a-8bac270fac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume 16114985-bb61-46d5-b60b-ec5c762f4367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16114985-bb61-46d5-b60b-ec5c762f4367', 'volume_size': 1}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] <== create_volume: return (2065ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.108s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051224460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ac8c7a-9443-46b1-a465-2a40db7a1911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:11Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Creating volume 23ac8c7a-9443-46b1-a465-2a40db7a1911 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:16 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-23ac8c7a-9443-46b1-a465-2a40db7a1911 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:16 devstack quobyte-client[83143]: System call of process 101308 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:16 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=151, name=volume-23ac8c7a-9443-46b1-a465-2a40db7a1911, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (4a156fc6-b34e-41e3-a638-c44272406905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493e719-6472-4358-a223-9c9697afbbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (ad5b1f2f-5e60-45de-8cac-f1660be46e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b80bf50-ecab-4329-9458-e3bfeb618c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493e719-6472-4358-a223-9c9697afbbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1121775685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3cf767-a3a9-458a-a552-c3b584dc7899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:15Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f266e1-a8cf-4822-ab9b-9a94e200987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f266e1-a8cf-4822-ab9b-9a94e200987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3413b5-4e0f-42e9-825c-b187ea53c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3413b5-4e0f-42e9-825c-b187ea53c278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3cf767-a3a9-458a-a552-c3b584dc7899', 'volume_name': 'volume-bc3cf767-a3a9-458a-a552-c3b584dc7899', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc91964-a0f0-475f-a2aa-ecee17f052b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc91964-a0f0-475f-a2aa-ecee17f052b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a8bb85-35e5-4806-a1bc-105da8b40d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume bc3cf767-a3a9-458a-a552-c3b584dc7899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3cf767-a3a9-458a-a552-c3b584dc7899', 'volume_size': 1}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74813b9c-3e70-45fa-8bdd-a9264b37c5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ace263a-1fb7-43fa-9861-27fba96bec88', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e5d584-621f-4897-93f2-9549d0dfa6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b80bf50-ecab-4329-9458-e3bfeb618c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847700609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cc24ae-0cf3-4c1a-b163-5df2a16ce720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:16Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9eef15f-31fb-4586-856b-6e18b2751420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9eef15f-31fb-4586-856b-6e18b2751420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5e0d49-2a83-4057-ba5d-817fc120225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5e0d49-2a83-4057-ba5d-817fc120225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5cc24ae-0cf3-4c1a-b163-5df2a16ce720', 'volume_name': 'volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b509a349-9df2-4978-8053-2f7ae96c8e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b509a349-9df2-4978-8053-2f7ae96c8e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930ed62d-5fe1-4c41-9b9d-a169f407c651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:16 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume c5cc24ae-0cf3-4c1a-b163-5df2a16ce720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720', 'volume_size': 1}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-23ac8c7a-9443-46b1-a465-2a40db7a1911 1073741824" returned: 0 in 0.923s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-23ac8c7a-9443-46b1-a465-2a40db7a1911 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Volume volume-0ace263a-1fb7-43fa-9861-27fba96bec88 (0ace263a-1fb7-43fa-9861-27fba96bec88): created successfully
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e5d584-621f-4897-93f2-9549d0dfa6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (c94a8092-d96d-40b5-8d74-568c066e8a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:17 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (d7abfecb-30d3-4743-b332-0135abb9282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431d6297-170f-42d4-96ea-34379184a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:17 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7bf1f7fb-5835-4ab0-9e5c-43b4946b0fc3 tempest-CreateVolumesFromImageTest-909639783 None] Created volume successfully.
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-23ac8c7a-9443-46b1-a465-2a40db7a1911" returned: 0 in 0.529s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431d6297-170f-42d4-96ea-34379184a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123871102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a02d6e2-bc24-484e-a6b8-4a3df1552bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:16Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c234031d-7aae-4890-abac-2670bed21a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c234031d-7aae-4890-abac-2670bed21a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9272e3-744a-4328-b776-3976141bb02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9272e3-744a-4328-b776-3976141bb02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a02d6e2-bc24-484e-a6b8-4a3df1552bce', 'volume_name': 'volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b1fdf6-8415-4d6b-98d4-735f46544295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b1fdf6-8415-4d6b-98d4-735f46544295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b3883e-896a-423e-9ef7-28c310f6ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume 0a02d6e2-bc24-484e-a6b8-4a3df1552bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce', 'volume_size': 1}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] <== create_volume: return (1531ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.868s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Creating offline snapshot 7bbcc9d8-7866-4041-adc4-6bb784d37a3d of volume 7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3671e5a-184a-400d-8327-b1ceb696be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ac8c7a-9443-46b1-a465-2a40db7a1911', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b6869a-d0ec-4cc2-9dc9-ae46a52260d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d6fa14-58d7-4484-8bc9-cc429bf47184]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Volume volume-23ac8c7a-9443-46b1-a465-2a40db7a1911 (23ac8c7a-9443-46b1-a465-2a40db7a1911): created successfully
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b6869a-d0ec-4cc2-9dc9-ae46a52260d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (f2af8dc2-e0ad-4f37-bfd0-1e3a9c6e4a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:18 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-26ba50e4-9774-4c0c-ace6-3b52962be1a5 tempest-CreateVolumesFromImageTest-909639783 None] Created volume successfully.
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" returned: 0 in 0.579s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:18 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=152, name=volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d 1G" returned: 0 in 0.308s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img rebase -u -b volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d" returned: 0 in 0.164s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d" returned: 0 in 0.093s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 20:03:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d" returned: 0 in 0.094s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.info" returned: 0 in 0.098s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.info" returned: 0 in 0.088s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.736s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.528s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-538786215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb8b4994f74554be0d2b8324329b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:11Z,use_quota=True,user_id='c35e4c7fdffe4a54926eddb04a013463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Creating volume c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:19 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:19 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=154, name=volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:20 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6af5e53f-ef69-4382-8996-24a1894a6db2 tempest-CreateVolumesFromSnapshotTest-348092003 None] Create snapshot completed successfully
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb 1073741824" returned: 0 in 0.448s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb" returned: 0 in 0.130s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] <== create_volume: return (632ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.292s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2032924848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d113cf-79f4-4fb5-8760-14098dd01f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:14Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Creating volume 07d113cf-79f4-4fb5-8760-14098dd01f76 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:20 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-07d113cf-79f4-4fb5-8760-14098dd01f76 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:20 devstack quobyte-client[83143]: System call of process 101329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:20 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=155, name=volume-07d113cf-79f4-4fb5-8760-14098dd01f76, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c2343b-b6fb-4a23-9695-f3b5977e89a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d400ea09-1653-4992-8323-88e5df91c866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:20 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Volume volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb (c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb): created successfully
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d400ea09-1653-4992-8323-88e5df91c866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Flow 'volume_create_manager' (444fc03f-5deb-4980-b826-1e72fc36f58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-07d113cf-79f4-4fb5-8760-14098dd01f76 1073741824" returned: 0 in 0.534s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-07d113cf-79f4-4fb5-8760-14098dd01f76 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:21 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-58b0d6ae-7132-4b44-8127-baa734cabb4b tempest-CreateVolumesFromImageTest-909639783 None] Created volume successfully.
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-07d113cf-79f4-4fb5-8760-14098dd01f76" returned: 0 in 0.383s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] <== create_volume: return (949ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.404s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1384043245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16114985-bb61-46d5-b60b-ec5c762f4367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:14Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Creating volume 16114985-bb61-46d5-b60b-ec5c762f4367 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:21 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-16114985-bb61-46d5-b60b-ec5c762f4367 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:21 devstack quobyte-client[83143]: System call of process 101333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:21 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=156, name=volume-16114985-bb61-46d5-b60b-ec5c762f4367, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8389ea43-9ca8-46b8-9100-81f1a89c2b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d113cf-79f4-4fb5-8760-14098dd01f76', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda2bbf8-88ea-47b0-875a-68d0d28635ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-16114985-bb61-46d5-b60b-ec5c762f4367 1073741824" returned: 0 in 0.718s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-16114985-bb61-46d5-b60b-ec5c762f4367 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:22 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (43b1706c-542a-4cb5-af4d-beedfc5b1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aeb3b23-574f-4a03-afbe-9c6b687ba285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:22 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume volume-07d113cf-79f4-4fb5-8760-14098dd01f76 (07d113cf-79f4-4fb5-8760-14098dd01f76): created successfully
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda2bbf8-88ea-47b0-875a-68d0d28635ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (20bec159-657d-445c-93d7-3f5b07d492bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:22 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (1e944a51-a689-4306-8052-f43e635a18d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d22c442-28ee-4ee4-ac16-5e6e358195fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:22 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6a155e99-4f33-442b-9185-f89510623d9e tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created volume successfully.
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-16114985-bb61-46d5-b60b-ec5c762f4367" returned: 0 in 0.790s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] <== create_volume: return (1545ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:22 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aeb3b23-574f-4a03-afbe-9c6b687ba285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987832928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a2b53e-3240-4709-a180-34abab3eeb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:21Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea4f198-f563-421c-878b-50d5b473a925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea4f198-f563-421c-878b-50d5b473a925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1eef0e2-ae5c-4890-90fc-d8ef6b138238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1eef0e2-ae5c-4890-90fc-d8ef6b138238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a2b53e-3240-4709-a180-34abab3eeb0a', 'volume_name': 'volume-e0a2b53e-3240-4709-a180-34abab3eeb0a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693669cb-06c6-4980-8db3-eaf4fef1323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693669cb-06c6-4980-8db3-eaf4fef1323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6835d01-50b3-44dd-be06-faf521854b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume e0a2b53e-3240-4709-a180-34abab3eeb0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a2b53e-3240-4709-a180-34abab3eeb0a', 'volume_size': 1}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987832928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a2b53e-3240-4709-a180-34abab3eeb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:21Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Creating volume e0a2b53e-3240-4709-a180-34abab3eeb0a {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:23 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a2b53e-3240-4709-a180-34abab3eeb0a 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb-delete_volume" acquired by "delete_volume" :: waited 0.699s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:23 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=157, name=volume-e0a2b53e-3240-4709-a180-34abab3eeb0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df80eadc-c5e6-45f5-860a-8bac270fac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16114985-bb61-46d5-b60b-ec5c762f4367', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed499d8a-1d9a-4ea1-b995-cb84dc88a653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d22c442-28ee-4ee4-ac16-5e6e358195fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-641422097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2aabfe-1c6e-4630-ae27-150785abb855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:22Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71b7dd7-7d8b-4bba-92d6-dee5f2070eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71b7dd7-7d8b-4bba-92d6-dee5f2070eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb9d750-88b0-48d1-90ce-565b3ab30851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb9d750-88b0-48d1-90ce-565b3ab30851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2aabfe-1c6e-4630-ae27-150785abb855', 'volume_name': 'volume-7e2aabfe-1c6e-4630-ae27-150785abb855', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3ab91c-ffd8-4a24-a76b-6e0211ffa62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3ab91c-ffd8-4a24-a76b-6e0211ffa62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c110421-9d7a-47ea-8115-d3b7d47b44e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:23 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume 7e2aabfe-1c6e-4630-ae27-150785abb855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2aabfe-1c6e-4630-ae27-150785abb855', 'volume_size': 1}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:23 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (76241f60-3613-4bd8-a94c-652211bbf9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:23 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec60eb0-2417-40dd-bd36-aca7ac734d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec60eb0-2417-40dd-bd36-aca7ac734d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-202518657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df61642-867f-41d3-823d-d4292768e7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:22Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224a438c-3592-4cc7-beb1-2588e4a44008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224a438c-3592-4cc7-beb1-2588e4a44008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0307bbd-cf4d-43e2-afc7-fc85fbb21667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0307bbd-cf4d-43e2-afc7-fc85fbb21667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df61642-867f-41d3-823d-d4292768e7de', 'volume_name': 'volume-8df61642-867f-41d3-823d-d4292768e7de', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a63b955-a346-49ae-a50f-2d77b183555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a63b955-a346-49ae-a50f-2d77b183555a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c1fc9a-0f47-4f54-a30c-cdaf9d64f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:24 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume 8df61642-867f-41d3-823d-d4292768e7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df61642-867f-41d3-823d-d4292768e7de', 'volume_size': 1}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:24 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume volume-16114985-bb61-46d5-b60b-ec5c762f4367 (16114985-bb61-46d5-b60b-ec5c762f4367): created successfully
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed499d8a-1d9a-4ea1-b995-cb84dc88a653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (2261c5c1-177d-49ac-9711-4c38b06cb17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a2b53e-3240-4709-a180-34abab3eeb0a 1073741824" returned: 0 in 1.011s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a2b53e-3240-4709-a180-34abab3eeb0a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:24 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-quobyte-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:24 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-e719da4f-b7e2-4cb2-845d-d2c62660a818 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created volume successfully.
Sep 17 20:03:24 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (76b57e40-edf3-47a6-83c3-38b383e023b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993b1b7a-f6a5-4830-9327-8372b365465b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a2b53e-3240-4709-a180-34abab3eeb0a" returned: 0 in 0.671s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] <== create_volume: return (1716ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb" acquired by "delete_volume" :: waited 0.275s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.806s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847700609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cc24ae-0cf3-4c1a-b163-5df2a16ce720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:16Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Creating volume c5cc24ae-0cf3-4c1a-b163-5df2a16ce720 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:24 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:24 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=158, name=volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993b1b7a-f6a5-4830-9327-8372b365465b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-685084720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951b1366-8004-4522-ae5c-c119c30f9030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:24Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9c2617-1b5a-43fa-940e-52bc23389cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9c2617-1b5a-43fa-940e-52bc23389cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e2b1e9-a961-4559-a3bc-7bff84ac4b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e2b1e9-a961-4559-a3bc-7bff84ac4b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '951b1366-8004-4522-ae5c-c119c30f9030', 'volume_name': 'volume-951b1366-8004-4522-ae5c-c119c30f9030', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aa8df1-bb9a-4980-a76b-e26469b0e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aa8df1-bb9a-4980-a76b-e26469b0e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c68b2a3-20cd-4add-904f-1846c50f6074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume 951b1366-8004-4522-ae5c-c119c30f9030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-951b1366-8004-4522-ae5c-c119c30f9030', 'volume_size': 1}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d5e02d-a026-4b3a-adc0-d61a3dfcb916]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:25 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (bf618b9f-e16d-41ad-9f01-fc129ba15c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f943c76f-422f-4c70-b75a-f01da9803db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6835d01-50b3-44dd-be06-faf521854b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a2b53e-3240-4709-a180-34abab3eeb0a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4021591-c840-4722-923f-662c1da92ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f943c76f-422f-4c70-b75a-f01da9803db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-618224579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27195b87-14d0-4ccf-9ea5-74560153929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:23Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb01b1a-b7c5-40cf-8237-42589e42a386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb01b1a-b7c5-40cf-8237-42589e42a386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd1fe6-7f68-409d-b87f-210d20f64f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd1fe6-7f68-409d-b87f-210d20f64f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27195b87-14d0-4ccf-9ea5-74560153929a', 'volume_name': 'volume-27195b87-14d0-4ccf-9ea5-74560153929a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8b7db1-497c-444d-b69c-685f356d8d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8b7db1-497c-444d-b69c-685f356d8d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b04c28-5b4a-4ace-a29b-4eaa40c8a212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:25 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume 27195b87-14d0-4ccf-9ea5-74560153929a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27195b87-14d0-4ccf-9ea5-74560153929a', 'volume_size': 1}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720 1073741824" returned: 0 in 1.100s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:25 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume volume-e0a2b53e-3240-4709-a180-34abab3eeb0a (e0a2b53e-3240-4709-a180-34abab3eeb0a): created successfully
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4021591-c840-4722-923f-662c1da92ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (43b1706c-542a-4cb5-af4d-beedfc5b1edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb" returned: 0 in 0.890s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:26 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a0e0b77d-7742-48d7-a148-0688139ce59e tempest-CreateVolumesFromSnapshotTest-348092003 None] Created volume successfully.
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720" returned: 0 in 0.459s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] <== create_volume: return (1596ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.860s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123871102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a02d6e2-bc24-484e-a6b8-4a3df1552bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:16Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Creating volume 0a02d6e2-bc24-484e-a6b8-4a3df1552bce {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:26 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb" returned: 0 in 0.461s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:26 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=159, name=volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930ed62d-5fe1-4c41-9b9d-a169f407c651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:26 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217e7677-0256-417a-8fa6-d057e7ebca43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb" released by "delete_volume" :: held 2.261s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:27 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720 (c5cc24ae-0cf3-4c1a-b163-5df2a16ce720): created successfully
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217e7677-0256-417a-8fa6-d057e7ebca43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (ad5b1f2f-5e60-45de-8cac-f1660be46e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce 1073741824" returned: 0 in 0.641s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:27 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d61f3c3c-b04d-427d-840e-b0b9ad1492b6 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created volume successfully.
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce" returned: 0 in 0.290s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] <== create_volume: return (987ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.586s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1121775685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3cf767-a3a9-458a-a552-c3b584dc7899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1af720d22e94591a7b538b93b564348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:15Z,use_quota=True,user_id='50256a58a0384449af191b4f812c5248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Creating volume bc3cf767-a3a9-458a-a552-c3b584dc7899 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:27 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:27 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bc3cf767-a3a9-458a-a552-c3b584dc7899 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:27 devstack quobyte-client[83143]: System call of process 101354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:27 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=160, name=volume-bc3cf767-a3a9-458a-a552-c3b584dc7899, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b3883e-896a-423e-9ef7-28c310f6ff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c947272-728c-4ad4-98ac-4a14227458e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bc3cf767-a3a9-458a-a552-c3b584dc7899 1073741824" returned: 0 in 0.556s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bc3cf767-a3a9-458a-a552-c3b584dc7899 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:28 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce (0a02d6e2-bc24-484e-a6b8-4a3df1552bce): created successfully
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c947272-728c-4ad4-98ac-4a14227458e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (d7abfecb-30d3-4743-b332-0135abb9282d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bc3cf767-a3a9-458a-a552-c3b584dc7899" returned: 0 in 0.375s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] <== create_volume: return (968ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.665s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-641422097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2aabfe-1c6e-4630-ae27-150785abb855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:22Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Creating volume 7e2aabfe-1c6e-4630-ae27-150785abb855 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:28 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7e2aabfe-1c6e-4630-ae27-150785abb855 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:28 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=161, name=volume-7e2aabfe-1c6e-4630-ae27-150785abb855, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:28 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Created reservations ['a55325e4-2b42-4b34-8827-b04933c774cc', '8fd99d14-b112-4f01-87d6-6c46ced0c491', '18c0453c-1135-4743-8229-c4fb7bc1248d', 'e760be5e-fbf2-4a5e-8296-768c446733a0'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:28 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b98a8e8d-f9af-494f-b259-b0cd724a9da0 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created volume successfully.
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a8bb85-35e5-4806-a1bc-105da8b40d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3cf767-a3a9-458a-a552-c3b584dc7899', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3616dde7-b202-42ee-8299-6c377df9b910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-23ac8c7a-9443-46b1-a465-2a40db7a1911-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7e2aabfe-1c6e-4630-ae27-150785abb855 1073741824" returned: 0 in 0.701s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7e2aabfe-1c6e-4630-ae27-150785abb855 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:29 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume volume-bc3cf767-a3a9-458a-a552-c3b584dc7899 (bc3cf767-a3a9-458a-a552-c3b584dc7899): created successfully
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3616dde7-b202-42ee-8299-6c377df9b910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Flow 'volume_create_manager' (4a156fc6-b34e-41e3-a638-c44272406905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7e2aabfe-1c6e-4630-ae27-150785abb855" returned: 0 in 0.442s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] <== create_volume: return (1181ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-23ac8c7a-9443-46b1-a465-2a40db7a1911-delete_volume" acquired by "delete_volume" :: waited 0.523s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.683s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-202518657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df61642-867f-41d3-823d-d4292768e7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:22Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Creating volume 8df61642-867f-41d3-823d-d4292768e7de {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:29 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df61642-867f-41d3-823d-d4292768e7de 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:29 devstack quobyte-client[83143]: System call of process 101362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:29 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-4850c5bf-1991-496a-b262-776ee128f62b tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created volume successfully.
Sep 17 20:03:29 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=162, name=volume-8df61642-867f-41d3-823d-d4292768e7de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c110421-9d7a-47ea-8115-d3b7d47b44e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2aabfe-1c6e-4630-ae27-150785abb855', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae391432-7552-4e4c-82a4-e2c9cd933bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df61642-867f-41d3-823d-d4292768e7de 1073741824" returned: 0 in 1.004s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df61642-867f-41d3-823d-d4292768e7de {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-0a02d6e2-bc24-484e-a6b8-4a3df1552bce-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:31 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume volume-7e2aabfe-1c6e-4630-ae27-150785abb855 (7e2aabfe-1c6e-4630-ae27-150785abb855): created successfully
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae391432-7552-4e4c-82a4-e2c9cd933bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (1e944a51-a689-4306-8052-f43e635a18d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:31 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-quobyte-23ac8c7a-9443-46b1-a465-2a40db7a1911" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.879s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df61642-867f-41d3-823d-d4292768e7de" returned: 0 in 0.439s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:31 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Deleted volume successfully.
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] <== create_volume: return (1590ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.265s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-685084720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951b1366-8004-4522-ae5c-c119c30f9030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:24Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Creating volume 951b1366-8004-4522-ae5c-c119c30f9030 {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:31 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-951b1366-8004-4522-ae5c-c119c30f9030 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:31 devstack quobyte-client[83143]: System call of process 101373 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:31 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=163, name=volume-951b1366-8004-4522-ae5c-c119c30f9030, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:31 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-68f482a1-39bd-4b5a-ac48-15d9dee47115 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created volume successfully.
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-23ac8c7a-9443-46b1-a465-2a40db7a1911" acquired by "delete_volume" :: waited 0.599s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-0a02d6e2-bc24-484e-a6b8-4a3df1552bce-delete_volume" acquired by "delete_volume" :: waited 0.888s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3381c181-fe98-4be5-8f2f-ac03d9a7db1c]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-23ac8c7a-9443-46b1-a465-2a40db7a1911 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c1fc9a-0f47-4f54-a30c-cdaf9d64f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df61642-867f-41d3-823d-d4292768e7de', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314d9631-06e3-4ee9-80eb-620138104e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-efb64a2d-9abe-41a1-bb64-74a7437565d5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-c2d1cfb3-1d1e-49bb-9192-a5a247a1b2eb-delete_volume" released by "delete_volume" :: held 9.070s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-951b1366-8004-4522-ae5c-c119c30f9030 1073741824" returned: 0 in 1.003s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:32 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume volume-8df61642-867f-41d3-823d-d4292768e7de (8df61642-867f-41d3-823d-d4292768e7de): created successfully
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314d9631-06e3-4ee9-80eb-620138104e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (76241f60-3613-4bd8-a94c-652211bbf9aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-951b1366-8004-4522-ae5c-c119c30f9030 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-951b1366-8004-4522-ae5c-c119c30f9030" returned: 0 in 0.372s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] <== create_volume: return (1454ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-23ac8c7a-9443-46b1-a465-2a40db7a1911" returned: 0 in 1.030s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.059s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-618224579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27195b87-14d0-4ccf-9ea5-74560153929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1582bc0d9d6f47959fda92af62a70c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:03:23Z,use_quota=True,user_id='1aabce340a4948acbee6c0854c6749a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Creating volume 27195b87-14d0-4ccf-9ea5-74560153929a {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:03:32 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:03:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-27195b87-14d0-4ccf-9ea5-74560153929a 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:33 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d4da1002-b57b-4cc3-88b3-7370ea91eac5 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created volume successfully.
Sep 17 20:03:33 devstack quobyte-client[83143]: System call of process 101380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:33 devstack quobyte-client[83143]: System call of process 101380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:33 devstack quobyte-client[83143]: System call of process 101380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:33 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=164, name=volume-27195b87-14d0-4ccf-9ea5-74560153929a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-23ac8c7a-9443-46b1-a465-2a40db7a1911 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-quobyte-0a02d6e2-bc24-484e-a6b8-4a3df1552bce" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c68b2a3-20cd-4add-904f-1846c50f6074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951b1366-8004-4522-ae5c-c119c30f9030', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bf21cf-20ba-4b8b-ae5a-ec981e567f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-23ac8c7a-9443-46b1-a465-2a40db7a1911" returned: 0 in 0.536s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:33 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume volume-951b1366-8004-4522-ae5c-c119c30f9030 (951b1366-8004-4522-ae5c-c119c30f9030): created successfully
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bf21cf-20ba-4b8b-ae5a-ec981e567f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (76b57e40-edf3-47a6-83c3-38b383e023b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-27195b87-14d0-4ccf-9ea5-74560153929a 1073741824" returned: 0 in 0.856s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-0a02d6e2-bc24-484e-a6b8-4a3df1552bce" acquired by "delete_volume" :: waited 0.239s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-27195b87-14d0-4ccf-9ea5-74560153929a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:33 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75fe728-1b08-4b86-99fe-cf5de69fbe23]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-23ac8c7a-9443-46b1-a465-2a40db7a1911" released by "delete_volume" :: held 2.249s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:34 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-fcd1f91c-0b50-4831-b22d-2747311a31f8 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created volume successfully.
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-27195b87-14d0-4ccf-9ea5-74560153929a" returned: 0 in 0.660s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] <== create_volume: return (1587ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b04c28-5b4a-4ace-a29b-4eaa40c8a212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27195b87-14d0-4ccf-9ea5-74560153929a', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adb9ed3-3bea-4a9d-a9a6-11f18be95f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:03:34 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume volume-27195b87-14d0-4ccf-9ea5-74560153929a (27195b87-14d0-4ccf-9ea5-74560153929a): created successfully
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adb9ed3-3bea-4a9d-a9a6-11f18be95f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Flow 'volume_create_manager' (bf618b9f-e16d-41ad-9f01-fc129ba15c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Created reservations ['10781ffb-83c8-4a5d-b3eb-6d31614a855c', '1d6514fd-562f-46ee-b229-8e356db39b21', '8be835b8-6c0d-4fd9-917d-163cedfc4b62', 'ea425eb7-9121-468a-9411-7b9d7d8c6aa6'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce" returned: 0 in 0.677s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:35 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-a2c90de0-e447-486d-b0de-35cfab5af397 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created volume successfully.
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0a02d6e2-bc24-484e-a6b8-4a3df1552bce" returned: 0 in 0.279s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-0a02d6e2-bc24-484e-a6b8-4a3df1552bce" released by "delete_volume" :: held 1.376s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-951b1366-8004-4522-ae5c-c119c30f9030-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:35 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created reservations ['0a873a27-8050-4995-b5ac-283b862dd870', '7c80e49e-384b-43c6-a679-b0519e51afba', '0007fb8b-aafd-4fad-b67a-369b9e3ac113', 'bb056cb1-6109-476c-9744-147c74f3d92f'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.514s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:36 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Deleted volume successfully.
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-951b1366-8004-4522-ae5c-c119c30f9030-delete_volume" acquired by "delete_volume" :: waited 0.272s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-0ace263a-1fb7-43fa-9861-27fba96bec88-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d76b1539-2059-4b93-93e6-fd3ae33e488d tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-23ac8c7a-9443-46b1-a465-2a40db7a1911-delete_volume" released by "delete_volume" :: held 6.469s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-0ace263a-1fb7-43fa-9861-27fba96bec88-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:36 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-quobyte-951b1366-8004-4522-ae5c-c119c30f9030" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:36 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-quobyte-0ace263a-1fb7-43fa-9861-27fba96bec88" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-951b1366-8004-4522-ae5c-c119c30f9030" acquired by "delete_volume" :: waited 0.029s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d325f7-85e8-46a2-a28e-ed34de23456d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-0ace263a-1fb7-43fa-9861-27fba96bec88" acquired by "delete_volume" :: waited 0.036s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-951b1366-8004-4522-ae5c-c119c30f9030 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ebb36-a78f-476c-b929-95533a13bd69]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0ace263a-1fb7-43fa-9861-27fba96bec88 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.034s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-951b1366-8004-4522-ae5c-c119c30f9030" returned: 0 in 1.123s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0ace263a-1fb7-43fa-9861-27fba96bec88" returned: 0 in 0.976s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-951b1366-8004-4522-ae5c-c119c30f9030 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0ace263a-1fb7-43fa-9861-27fba96bec88 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:37 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720-delete_volume" acquired by "delete_volume" :: waited 0.386s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.974s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:37 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Deleted volume successfully.
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-951b1366-8004-4522-ae5c-c119c30f9030" returned: 0 in 0.513s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-0ace263a-1fb7-43fa-9861-27fba96bec88" returned: 0 in 0.451s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-951b1366-8004-4522-ae5c-c119c30f9030" released by "delete_volume" :: held 1.733s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-0ace263a-1fb7-43fa-9861-27fba96bec88" released by "delete_volume" :: held 1.721s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-52faabba-c7ae-41c5-a6d9-d90623962d66 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-0a02d6e2-bc24-484e-a6b8-4a3df1552bce-delete_volume" released by "delete_volume" :: held 6.610s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Created reservations ['89ba773b-3a82-4894-b02c-2ffa23fb3c08', '181fec1b-bc4e-4ea2-b4f1-e15554e8bf9a', '7987357d-4789-4300-b30f-057e260841c6', '1a37f7f9-93b5-454b-8316-217302048351'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created reservations ['1cfeed88-29a4-4178-bb3b-30702b52e48e', '90802d44-5b09-453d-b773-9d13a5849884', 'd3934256-a305-403c-8084-ae450a2180c4', 'ff3e5c66-eab4-4a57-b805-d645da95c775'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:38 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-quobyte-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720" acquired by "delete_volume" :: waited 0.054s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45a85af-105d-4f56-b59e-5584d6332fad]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-27195b87-14d0-4ccf-9ea5-74560153929a-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720" returned: 0 in 1.137s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-27195b87-14d0-4ccf-9ea5-74560153929a-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528-delete_volume" acquired by "delete_volume" :: waited 0.179s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720" returned: 0 in 0.420s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720" released by "delete_volume" :: held 1.808s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:41 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-quobyte-27195b87-14d0-4ccf-9ea5-74560153929a" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:41 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-quobyte-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.493s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:41 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Deleted volume successfully.
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-27195b87-14d0-4ccf-9ea5-74560153929a" acquired by "delete_volume" :: waited 0.134s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528" acquired by "delete_volume" :: waited 0.118s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d38deff-f339-4df3-a510-f0ae6a6be097]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-27195b87-14d0-4ccf-9ea5-74560153929a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0ec08d-20ba-4824-a22c-1e1af476ef9f]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.049s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:42 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-65789c10-e0d3-4b0c-9d96-c63b2e2d8279 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-951b1366-8004-4522-ae5c-c119c30f9030-delete_volume" released by "delete_volume" :: held 6.226s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-27195b87-14d0-4ccf-9ea5-74560153929a" returned: 0 in 1.078s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-27195b87-14d0-4ccf-9ea5-74560153929a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528" returned: 0 in 0.999s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:42 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created reservations ['7fa875ea-f1a9-4db2-ad4a-a3c1c453acaf', '0f76d891-ec4c-4b1a-8f00-f06654cf0407', 'f5160443-eac6-4597-8f0b-6d755d00f5fe', 'f447be2c-fab8-481e-afa4-a2795918f01e'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.997s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:43 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Deleted volume successfully.
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-27195b87-14d0-4ccf-9ea5-74560153929a" returned: 0 in 0.740s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528" returned: 0 in 0.451s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528" released by "delete_volume" :: held 1.944s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-27195b87-14d0-4ccf-9ea5-74560153929a" released by "delete_volume" :: held 1.969s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-7fe16be4-3af0-4d4f-9d4c-02a9824b823d tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-0ace263a-1fb7-43fa-9861-27fba96bec88-delete_volume" released by "delete_volume" :: held 7.077s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created reservations ['81f69b66-2cbe-4564-aed9-580408a1a882', '0a4b1d1e-2ef7-4ea0-abde-243301de0a2a', 'e5a14711-b5ba-49dc-bbaa-f3778c2b757d', 'ca2b763c-0dea-404f-8f31-0be40de812c2'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.350s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:43 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Deleted volume successfully.
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-bc3cf767-a3a9-458a-a552-c3b584dc7899-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Created reservations ['ce580380-ec75-4122-a3c2-a6699173a7da', '626a6fa6-d3c8-4770-9161-00929c20e8b1', '6d106a84-af24-4c5b-99fa-fb7e9dc11afc', 'aac4b80c-9225-4691-9fb0-245d00b5c5ef'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-bc3cf767-a3a9-458a-a552-c3b584dc7899-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-867e9d1c-7dba-49b3-b504-09f709e7a0fd tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-c5cc24ae-0cf3-4c1a-b163-5df2a16ce720-delete_volume" released by "delete_volume" :: held 6.238s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:44 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-quobyte-bc3cf767-a3a9-458a-a552-c3b584dc7899" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-8df61642-867f-41d3-823d-d4292768e7de-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-d5501fb7-b6d3-4732-beb5-e7ac708468c8-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-bc3cf767-a3a9-458a-a552-c3b584dc7899" acquired by "delete_volume" :: waited 0.442s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.464s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:44 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Deleted volume successfully.
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0dc4b1-3f9d-4186-b688-e0a37f609c0b]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-8df61642-867f-41d3-823d-d4292768e7de-delete_volume" acquired by "delete_volume" :: waited 0.254s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bc3cf767-a3a9-458a-a552-c3b584dc7899 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-d5501fb7-b6d3-4732-beb5-e7ac708468c8-delete_volume" acquired by "delete_volume" :: waited 0.428s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-b34a6809-7e0d-4d47-b8d1-83b3e040ba09 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-27195b87-14d0-4ccf-9ea5-74560153929a-delete_volume" released by "delete_volume" :: held 5.362s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:45 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "cinder-quobyte-d5501fb7-b6d3-4732-beb5-e7ac708468c8" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bc3cf767-a3a9-458a-a552-c3b584dc7899" returned: 0 in 1.030s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bc3cf767-a3a9-458a-a552-c3b584dc7899 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.602s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:45 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:46 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Deleted volume successfully.
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-d5501fb7-b6d3-4732-beb5-e7ac708468c8" acquired by "delete_volume" :: waited 0.474s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-bc3cf767-a3a9-458a-a552-c3b584dc7899" returned: 0 in 0.466s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:46 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-quobyte-8df61642-867f-41d3-823d-d4292768e7de" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[29535fe6-6883-4487-b4a5-96e38b231c81]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-bc3cf767-a3a9-458a-a552-c3b584dc7899" released by "delete_volume" :: held 1.921s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-2ebb322e-62e1-45a2-a258-8eea3f050f34 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-f0eaac1e-39cd-473d-a08f-3cd3d6aa3528-delete_volume" released by "delete_volume" :: held 6.581s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-8df61642-867f-41d3-823d-d4292768e7de" acquired by "delete_volume" :: waited 0.457s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a600f3d-6abf-4a43-bc49-aac2f5bc27ab]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df61642-867f-41d3-823d-d4292768e7de {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:46 devstack quobyte-client[83143]: System call of process 101455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8" returned: 0 in 0.808s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-d5501fb7-b6d3-4732-beb5-e7ac708468c8" returned: 0 in 0.263s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:47 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-quobyte-d5501fb7-b6d3-4732-beb5-e7ac708468c8" released by "delete_volume" :: held 1.279s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df61642-867f-41d3-823d-d4292768e7de" returned: 0 in 0.783s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df61642-867f-41d3-823d-d4292768e7de {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:47 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created reservations ['d8f15a9c-29e6-4366-a5e1-9db3619a51d2', 'f65cfea3-8f2a-47e4-8a3f-bf0c6878ce1b', 'a4203883-9cdf-4666-b220-26b278bd4f7c', 'b4af9b5d-4817-4689-9cb2-d12d9377414a'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:47 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8df61642-867f-41d3-823d-d4292768e7de" returned: 0 in 0.406s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-8df61642-867f-41d3-823d-d4292768e7de" released by "delete_volume" :: held 1.391s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Created reservations ['9e6b83ca-1cbf-4ec9-99cf-782054d03623', '1bbe1b80-8069-44ea-8aaf-95e34f99720e', '7854bd7e-a7b3-46ac-9be5-d948f76dca71', '4a1202b1-256f-4bf5-b173-c9c8ec2c6f5a'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created reservations ['b8d97bef-31e1-4cb2-85fe-addc3283929e', '876e4f45-d02f-4f40-8841-7839017b9ef2', '2e8fe398-ea1e-4a23-bd62-64a156fd7fab', 'b5f36278-0d26-4482-b57b-e28a9dd95c1e'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-16114985-bb61-46d5-b60b-ec5c762f4367-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.579s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-16114985-bb61-46d5-b60b-ec5c762f4367-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-7e2aabfe-1c6e-4630-ae27-150785abb855-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:48 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Deleted volume successfully.
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:48 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-7e2aabfe-1c6e-4630-ae27-150785abb855-delete_volume" acquired by "delete_volume" :: waited 0.726s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-6c5ef334-efd8-4bf2-b209-a2aa4a475c60 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-bc3cf767-a3a9-458a-a552-c3b584dc7899-delete_volume" released by "delete_volume" :: held 5.713s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:49 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-quobyte-16114985-bb61-46d5-b60b-ec5c762f4367" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.904s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.609s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:49 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Deleted volume successfully.
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-16114985-bb61-46d5-b60b-ec5c762f4367" acquired by "delete_volume" :: waited 0.095s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:49 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-quobyte-7e2aabfe-1c6e-4630-ae27-150785abb855" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[57019053-9cb5-43f9-82be-830f5f186650]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:49 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-16114985-bb61-46d5-b60b-ec5c762f4367 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-706a3597-04f4-406d-b97b-1f3059c76da5 tempest-CreateVolumesFromImageTest-909639783 None] Lock "cinder-d5501fb7-b6d3-4732-beb5-e7ac708468c8-delete_volume" released by "delete_volume" :: held 5.235s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:50 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-7e2aabfe-1c6e-4630-ae27-150785abb855" acquired by "delete_volume" :: waited 0.434s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:50 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Deleted volume successfully.
Sep 17 20:03:50 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1ab413-436d-42f1-a525-d5146bed6e25]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:50 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7e2aabfe-1c6e-4630-ae27-150785abb855 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:51 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-9a3ad71f-c041-4fdc-9cf9-192c4d06ea35 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-8df61642-867f-41d3-823d-d4292768e7de-delete_volume" released by "delete_volume" :: held 6.327s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-16114985-bb61-46d5-b60b-ec5c762f4367" returned: 0 in 1.155s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-16114985-bb61-46d5-b60b-ec5c762f4367 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-16114985-bb61-46d5-b60b-ec5c762f4367" returned: 0 in 0.339s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7e2aabfe-1c6e-4630-ae27-150785abb855" returned: 0 in 0.947s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:51 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-16114985-bb61-46d5-b60b-ec5c762f4367" released by "delete_volume" :: held 1.607s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:51 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7e2aabfe-1c6e-4630-ae27-150785abb855 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7e2aabfe-1c6e-4630-ae27-150785abb855" returned: 0 in 0.376s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-7e2aabfe-1c6e-4630-ae27-150785abb855" released by "delete_volume" :: held 1.690s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created reservations ['06b58986-edd3-4430-9499-88e3d2797148', '64901e19-e3d4-4290-8639-cd9ca2d8fbbe', '3758c12f-3f98-4765-b0db-d8086c1a30b6', 'd6a032ea-230b-4816-a2d2-0f8ce95f1853'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created reservations ['37f9933a-3d1e-4c8f-97b4-ec7abc475900', '6f50de2a-2749-4785-8f8a-374f3d7cafa3', 'ab2e09b6-67cd-4ba2-b0cc-576c4d8a3d65', 'f11cfc59-437e-4abc-9334-94dba4f10b86'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-e0a2b53e-3240-4709-a180-34abab3eeb0a-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.464s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:52 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-e0a2b53e-3240-4709-a180-34abab3eeb0a-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:52 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Deleted volume successfully.
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:53 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-quobyte-e0a2b53e-3240-4709-a180-34abab3eeb0a" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-07d113cf-79f4-4fb5-8760-14098dd01f76-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f27896c-f868-43a9-b529-f49d4d5f3e01 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-16114985-bb61-46d5-b60b-ec5c762f4367-delete_volume" released by "delete_volume" :: held 4.762s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.597s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-e0a2b53e-3240-4709-a180-34abab3eeb0a" acquired by "delete_volume" :: waited 0.125s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-07d113cf-79f4-4fb5-8760-14098dd01f76-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf013739-85e7-4f7f-b77f-25a96148867b]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a2b53e-3240-4709-a180-34abab3eeb0a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:54 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Deleted volume successfully.
Sep 17 20:03:54 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-quobyte-07d113cf-79f4-4fb5-8760-14098dd01f76" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-631cafd4-39c7-4315-a38c-ddd1caa27813 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-7e2aabfe-1c6e-4630-ae27-150785abb855-delete_volume" released by "delete_volume" :: held 4.785s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a2b53e-3240-4709-a180-34abab3eeb0a" returned: 0 in 0.667s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a2b53e-3240-4709-a180-34abab3eeb0a {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-07d113cf-79f4-4fb5-8760-14098dd01f76" acquired by "delete_volume" :: waited 0.245s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[711c7b6c-7772-4592-aabf-843114d7600c]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-07d113cf-79f4-4fb5-8760-14098dd01f76 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a2b53e-3240-4709-a180-34abab3eeb0a" returned: 0 in 0.591s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.394s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-e0a2b53e-3240-4709-a180-34abab3eeb0a" released by "delete_volume" :: held 1.497s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:55 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:55 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Created reservations ['8de8ceaf-814d-455a-a722-c9ee5fb72756', '94942813-795f-4213-843d-49b420ea6908', 'f660798c-9caf-4921-9d6d-c79dca7b523a', '9598cab4-9a59-4299-95b2-68c87320c0f9'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:55 devstack quobyte-client[83143]: System call of process 101482 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:03:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-07d113cf-79f4-4fb5-8760-14098dd01f76" returned: 0 in 0.852s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-07d113cf-79f4-4fb5-8760-14098dd01f76 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-07d113cf-79f4-4fb5-8760-14098dd01f76" returned: 0 in 0.228s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-07d113cf-79f4-4fb5-8760-14098dd01f76" released by "delete_volume" :: held 1.476s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-7bbcc9d8-7866-4041-adc4-6bb784d37a3d-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-7bbcc9d8-7866-4041-adc4-6bb784d37a3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.526s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:56 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-quobyte-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.522s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:56 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Deleted volume successfully.
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" acquired by "delete_snapshot" :: waited 0.191s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-quobyte-7bbcc9d8-7866-4041-adc4-6bb784d37a3d" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-7bbcc9d8-7866-4041-adc4-6bb784d37a3d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Deleting offline snapshot 7bbcc9d8-7866-4041-adc4-6bb784d37a3d of volume 7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] snapshot_file for this snap is: volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-8553a797-1702-4272-a110-42fba6a4ed94 tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-e0a2b53e-3240-4709-a180-34abab3eeb0a-delete_volume" released by "delete_volume" :: held 4.086s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f5bbc-2cc7-4016-b43c-216cee974c79]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created reservations ['0125b1db-4c5d-412a-b278-7b8c82b74bf6', '08da6704-0ded-4490-86e6-2f2a83ef4e58', 'd6ce92c7-073c-43b5-835e-3a3b89d10e7c', '0ab0a6b5-ccf0-47f1-a894-5591d70f7df7'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d" returned: 0 in 0.688s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c5448d-c5c8-419c-aac2-4aacfb98ca47]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-3f470935-6c3a-4cfe-8d19-dfde401dd52f-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.587s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:58 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:03:58 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Deleted volume successfully.
Sep 17 20:03:58 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=88,cinder:UPDATE=144,cinder:DELETE=16,cinder:INSERT=28 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:03:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-3f470935-6c3a-4cfe-8d19-dfde401dd52f-delete_volume" acquired by "delete_volume" :: waited 0.397s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" returned: 0 in 0.724s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0dfde9ed-1582-4c37-ad0f-8575d16aa803 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-07d113cf-79f4-4fb5-8760-14098dd01f76-delete_volume" released by "delete_volume" :: held 5.255s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d" returned: 0 in 0.453s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7.7bbcc9d8-7866-4041-adc4-6bb784d37a3d" returned: 0 in 0.445s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:03:59 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "cinder-quobyte-3f470935-6c3a-4cfe-8d19-dfde401dd52f" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-7bbcc9d8-7866-4041-adc4-6bb784d37a3d" released by "_delete_snapshot" :: held 2.690s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" released by "delete_snapshot" :: held 2.739s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-3f470935-6c3a-4cfe-8d19-dfde401dd52f" acquired by "delete_volume" :: waited 0.096s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4e643e-d73d-4451-a378-642bbe96db98]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:03:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:00 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Created reservations ['ab0d8b7c-a0bd-41d7-8f26-23da325baef6', 'bc696463-f7c8-4903-8997-b150679516b1', '23c987a8-ba8d-4f03-be41-56361de149ab', '373a8624-c86a-4e5f-8d76-68666a7cd3d8'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f" returned: 0 in 0.756s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-3f470935-6c3a-4cfe-8d19-dfde401dd52f" returned: 0 in 0.219s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-quobyte-3f470935-6c3a-4cfe-8d19-dfde401dd52f" released by "delete_volume" :: held 1.165s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:01 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Delete snapshot completed successfully.
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-092a3a97-4acf-4b53-aa17-d1ca705009dd tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-7bbcc9d8-7866-4041-adc4-6bb784d37a3d-delete_snapshot" released by "delete_snapshot" :: held 4.336s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Created reservations ['ec847fbb-2dc7-4667-ba42-6188c2c02752', '5dfd9204-8efc-40f3-98b9-5b4430c51706', '41daa2fe-513f-409f-83df-bfb134044751', '33d9ae91-c797-4612-92a6-b6fc5d3a6157'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.244s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:01 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:04:01 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Deleted volume successfully.
Sep 17 20:04:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-d4bf099c-9514-49c9-9384-594a88601b81 tempest-CreateVolumesFromSourceVolumeTest-1462049512 None] Lock "cinder-3f470935-6c3a-4cfe-8d19-dfde401dd52f-delete_volume" released by "delete_volume" :: held 3.637s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:02 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "cinder-quobyte-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:02 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" acquired by "delete_volume" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:02 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82230548-7235-481d-8472-e0a24ef1f94a]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:02 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" returned: 0 in 0.604s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:03 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" returned: 0 in 0.184s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:03 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-quobyte-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7" released by "delete_volume" :: held 1.035s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Created reservations ['5c1553da-906b-4070-b2f4-3256e3e6e7fe', '0ec11307-117a-41ef-96a1-834f246fa253', '87215d4c-38e1-4d32-813a-f9f534835462', '8176329f-8100-4243-b6bf-497e1433fbcd'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.127s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:04 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:04:04 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Deleted volume successfully.
Sep 17 20:04:05 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bc2f60ba-0640-492e-b43a-6e8f516d9c3d tempest-CreateVolumesFromSnapshotTest-348092003 None] Lock "cinder-7dec8b31-fc23-42dc-8e95-4e6fd6a33cf7-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:10 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=113,cinder:UPDATE=192,cinder:DELETE=18,cinder:INSERT=39 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:04:10 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Flow 'volume_create_manager' (0717515c-0567-45c6-87aa-0624081838a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8a4b02-aecd-451c-9e99-929936aaea98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8a4b02-aecd-451c-9e99-929936aaea98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b1cb6d-6a31-4646-b0ae-8d57dfce574e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce379ad130048838a7becd3545a256d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:11Z,use_quota=True,user_id='0e62ee95dce4417faed0f267bc00113e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6becd44d-a258-4817-a7b2-82016262aa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6becd44d-a258-4817-a7b2-82016262aa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccabf15-4b92-4904-bb3f-d83e8c6cb8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccabf15-4b92-4904-bb3f-d83e8c6cb8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b1cb6d-6a31-4646-b0ae-8d57dfce574e', 'volume_name': 'volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3604882-d253-414e-9d84-8215ebde5eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3604882-d253-414e-9d84-8215ebde5eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1243cc-7608-41c1-ac0d-e889dc81bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:11 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Volume 85b1cb6d-6a31-4646-b0ae-8d57dfce574e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e', 'volume_size': 1}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b1cb6d-6a31-4646-b0ae-8d57dfce574e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce379ad130048838a7becd3545a256d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:11Z,use_quota=True,user_id='0e62ee95dce4417faed0f267bc00113e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Creating volume 85b1cb6d-6a31-4646-b0ae-8d57dfce574e {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:04:11 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:11 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=165, name=volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e 1073741824" returned: 0 in 0.562s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:11 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e" returned: 0 in 0.405s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] <== create_volume: return (1045ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:12 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Flow 'volume_create_manager' (db45db2a-e8fd-4c6b-929e-22bd0a25b27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b16f3ee-8088-443b-b765-7b28f4c733b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b16f3ee-8088-443b-b765-7b28f4c733b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df30db3-85f0-4424-88da-737fc546ef3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da236a801f84f96aa4af4c2c6ab6395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:12Z,use_quota=True,user_id='4db27ad1704f49c98db09b72be7eef36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d1a8c7-c66a-4f87-95ad-d0f27ddf251b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d1a8c7-c66a-4f87-95ad-d0f27ddf251b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27d9245-10f1-4e2b-bd26-df6816833fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.image.glance [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Creating Keystone auth plugin from conf {{(pid=83122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1243cc-7608-41c1-ac0d-e889dc81bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d912643-0599-4388-96ac-7b13d8699646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:12 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Volume volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e (85b1cb6d-6a31-4646-b0ae-8d57dfce574e): created successfully
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d912643-0599-4388-96ac-7b13d8699646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:12 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Flow 'volume_create_manager' (0717515c-0567-45c6-87aa-0624081838a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:12 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b7a4e42e-b1bf-4467-861e-9318cdda0150 tempest-CinderUnicodeTest-28640829 None] Created volume successfully.
Sep 17 20:04:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27d9245-10f1-4e2b-bd26-df6816833fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6df30db3-85f0-4424-88da-737fc546ef3f', 'volume_name': 'volume-6df30db3-85f0-4424-88da-737fc546ef3f', 'volume_size': 1, 'image_id': '7bf73984-c6b1-492b-96dc-881be67623b0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf73984-c6b1-492b-96dc-881be67623b0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '836fc204943aa31266a74271e71bb322', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5da236a801f84f96aa4af4c2c6ab6395', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaee23db70c67dddb7922b2ffb8454b9fc57e1d1823baa906339c377accb7eb551e80e0a6cdad4bea50f636e0dfd8002477c224bce76526832635db87428cee6', 'id': '7bf73984-c6b1-492b-96dc-881be67623b0', 'created_at': datetime.datetime(2025, 9, 17, 18, 4, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 18, 4, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf73984-c6b1-492b-96dc-881be67623b0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842283bb80>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61835302-2307-48d3-9952-d1a52d8901a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61835302-2307-48d3-9952-d1a52d8901a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:13 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbe5cb6-9d17-4892-a035-5efc80b64354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:13 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Volume 6df30db3-85f0-4424-88da-737fc546ef3f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6df30db3-85f0-4424-88da-737fc546ef3f', 'volume_size': 1, 'image_id': '7bf73984-c6b1-492b-96dc-881be67623b0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf73984-c6b1-492b-96dc-881be67623b0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '836fc204943aa31266a74271e71bb322', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5da236a801f84f96aa4af4c2c6ab6395', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaee23db70c67dddb7922b2ffb8454b9fc57e1d1823baa906339c377accb7eb551e80e0a6cdad4bea50f636e0dfd8002477c224bce76526832635db87428cee6', 'id': '7bf73984-c6b1-492b-96dc-881be67623b0', 'created_at': datetime.datetime(2025, 9, 17, 18, 4, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 18, 4, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf73984-c6b1-492b-96dc-881be67623b0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842283bb80>}
Sep 17 20:04:13 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Cloning 6df30db3-85f0-4424-88da-737fc546ef3f from image 7bf73984-c6b1-492b-96dc-881be67623b0  at location (None, [{'url': 'file:///opt/stack/data/glance/images/7bf73984-c6b1-492b-96dc-881be67623b0', 'metadata': {}}]). {{(pid=83122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 17 20:04:13 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 20:04:13 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Image download 0.00 MB at 0.00 MB/s
Sep 17 20:04:13 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5acf90-5cb6-43ae-9bd0-83d47250825d]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:13 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:14 devstack sudo[101517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD
Sep 17 20:04:14 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 20:04:14 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:14 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:04:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Flow 'volume_create_manager' (db289e3a-8a1b-4139-a2c9-b8a6680a3c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:14 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb5480b-bd88-4509-adfe-e75f2c62d60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb5480b-bd88-4509-adfe-e75f2c62d60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1318372484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a40972-141e-448c-b0e0-566a5d64d26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce379ad130048838a7becd3545a256d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:14Z,use_quota=True,user_id='0e62ee95dce4417faed0f267bc00113e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75129294-6c54-47ce-8c24-89bdda06d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75129294-6c54-47ce-8c24-89bdda06d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11381888-5d43-4c3a-8f2f-28a5ce6235d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11381888-5d43-4c3a-8f2f-28a5ce6235d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a40972-141e-448c-b0e0-566a5d64d26c', 'volume_name': 'volume-e0a40972-141e-448c-b0e0-566a5d64d26c', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9911fab-9ce7-4970-a0d6-90f887d4f5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9911fab-9ce7-4970-a0d6-90f887d4f5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5351a7c-b770-4e8c-a725-56f5517f7093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:15 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Volume e0a40972-141e-448c-b0e0-566a5d64d26c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a40972-141e-448c-b0e0-566a5d64d26c', 'volume_size': 1}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1318372484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a40972-141e-448c-b0e0-566a5d64d26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce379ad130048838a7becd3545a256d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:14Z,use_quota=True,user_id='0e62ee95dce4417faed0f267bc00113e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Creating volume e0a40972-141e-448c-b0e0-566a5d64d26c {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.160s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:04:15 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:04:15 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:15 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=166, name=volume-e0a40972-141e-448c-b0e0-566a5d64d26c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:04:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c 1073741824" returned: 0 in 0.667s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c" returned: 0 in 0.142s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:16 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] <== create_volume: return (1053ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:04:16 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5351a7c-b770-4e8c-a725-56f5517f7093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a40972-141e-448c-b0e0-566a5d64d26c', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980f81a1-fdfc-42c7-ba82-7429058924fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:17 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Volume volume-e0a40972-141e-448c-b0e0-566a5d64d26c (e0a40972-141e-448c-b0e0-566a5d64d26c): created successfully
Sep 17 20:04:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980f81a1-fdfc-42c7-ba82-7429058924fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:17 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Flow 'volume_create_manager' (db289e3a-8a1b-4139-a2c9-b8a6680a3c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:17 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-b3da210a-9cac-47f2-80b0-7d559faa56c3 tempest-CinderUnicodeTest-28640829 None] Created volume successfully.
Sep 17 20:04:17 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root
Sep 17 20:04:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD" returned: 0 in 4.024s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:17 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:18 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:18 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD
Sep 17 20:04:18 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 20:04:18 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Creating offline snapshot 83f6db34-cdb6-46b3-82be-fb4d0e05df66 of volume e0a40972-141e-448c-b0e0-566a5d64d26c {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 20:04:18 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5c67f-ae50-4579-827a-43c1c1676e0d]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:18 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c" returned: 0 in 0.657s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:19 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=167, name=volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:04:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 1G" returned: 0 in 0.309s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e0a40972-141e-448c-b0e0-566a5d64d26c -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:19 devstack quobyte-client[83143]: System call of process 101535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] CMD "qemu-img rebase -u -b volume-e0a40972-141e-448c-b0e0-566a5d64d26c -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66" returned: 0 in 0.249s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:19 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:04:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:19 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66" returned: 0 in 0.169s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 20:04:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66" returned: 0 in 0.236s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.info" returned: 0 in 0.401s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:20 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:04:20 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.info" returned: 0 in 0.198s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.813s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:21 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Sep 17 20:04:21 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-8d543190-38df-40b2-911c-f2706c3a816c tempest-CinderUnicodeTest-28640829 None] Create snapshot completed successfully
Sep 17 20:04:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD" returned: 1 in 3.997s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 20:04:21 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Temporary image 7bf73984-c6b1-492b-96dc-881be67623b0 is fetched for user 4db27ad1704f49c98db09b72be7eef36. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 20:04:21 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fdb5fa-f48c-43ac-8220-4e8ad13242ca]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:21 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Acquiring lock "cinder-83f6db34-cdb6-46b3-82be-fb4d0e05df66-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:22 devstack sudo[101545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD
Sep 17 20:04:22 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Lock "cinder-83f6db34-cdb6-46b3-82be-fb4d0e05df66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.233s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:22 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Acquiring lock "cinder-quobyte-e0a40972-141e-448c-b0e0-566a5d64d26c" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Lock "cinder-quobyte-e0a40972-141e-448c-b0e0-566a5d64d26c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Acquiring lock "cinder-quobyte-83f6db34-cdb6-46b3-82be-fb4d0e05df66" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Lock "cinder-quobyte-83f6db34-cdb6-46b3-82be-fb4d0e05df66" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Deleting offline snapshot 83f6db34-cdb6-46b3-82be-fb4d0e05df66 of volume e0a40972-141e-448c-b0e0-566a5d64d26c {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] snapshot_file for this snap is: volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 20:04:22 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec77ae-406c-4b81-8887-273150329e31]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:23 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:23 devstack quobyte-client[83143]: System call of process 101547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66" returned: 0 in 1.043s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:24 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0a40972-141e-448c-b0e0-566a5d64d26c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 20:04:24 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4ed832-e05e-444b-adb6-e7c84d07c786]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:24 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c" returned: 0 in 0.769s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:25 devstack quobyte-client[83143]: System call of process 101555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:25 devstack quobyte-client[83143]: System call of process 101555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66" returned: 0 in 0.517s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:25 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:26 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root
Sep 17 20:04:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c.83f6db34-cdb6-46b3-82be-fb4d0e05df66" returned: 0 in 0.320s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Lock "cinder-quobyte-83f6db34-cdb6-46b3-82be-fb4d0e05df66" released by "_delete_snapshot" :: held 3.337s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD" returned: 0 in 4.383s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:26 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:26 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Lock "cinder-quobyte-e0a40972-141e-448c-b0e0-566a5d64d26c" released by "delete_snapshot" :: held 3.531s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:27 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Created reservations ['56b31f25-8d23-415b-9459-60a5918c57be', 'c6141792-9104-45e9-87f6-39173dfd81c8', '9fd7bd7f-0082-41a7-be0a-7dda09ae4de7', '9a493dbc-050c-431e-935f-3f4d959d690e'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:27 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Delete snapshot completed successfully.
Sep 17 20:04:27 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-cd8d7622-f146-406d-ac28-b74fb6413158 tempest-CinderUnicodeTest-28640829 None] Lock "cinder-83f6db34-cdb6-46b3-82be-fb4d0e05df66-delete_snapshot" released by "delete_snapshot" :: held 4.400s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:27 devstack sudo[101560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD
Sep 17 20:04:27 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 20:04:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Acquiring lock "cinder-e0a40972-141e-448c-b0e0-566a5d64d26c-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Lock "cinder-e0a40972-141e-448c-b0e0-566a5d64d26c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:28 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Acquiring lock "cinder-quobyte-e0a40972-141e-448c-b0e0-566a5d64d26c" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:28 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Lock "cinder-quobyte-e0a40972-141e-448c-b0e0-566a5d64d26c" acquired by "delete_volume" :: waited 0.026s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:28 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b56675-b8ba-4169-8268-764320972f22]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:28 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c" returned: 0 in 0.851s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-e0a40972-141e-448c-b0e0-566a5d64d26c" returned: 0 in 0.270s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:29 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root
Sep 17 20:04:29 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Lock "cinder-quobyte-e0a40972-141e-448c-b0e0-566a5d64d26c" released by "delete_volume" :: held 1.459s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD" returned: 1 in 3.709s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:29 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df30db3-85f0-4424-88da-737fc546ef3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da236a801f84f96aa4af4c2c6ab6395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:12Z,use_quota=True,user_id='4db27ad1704f49c98db09b72be7eef36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Creating volume 6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:04:30 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:30 devstack quobyte-client[83143]: System call of process 101569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:30 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=169, name=volume-6df30db3-85f0-4424-88da-737fc546ef3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Created reservations ['8906fbf8-9408-4945-881d-b311b3c79d40', '9eae46de-35e3-41e2-aac1-fd62daba8dfd', '266feac4-17fc-490d-9275-dfd2f00e2eea', 'b42a4b4a-761e-4601-9415-76b1d58249de'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f 1073741824" returned: 0 in 0.519s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:30 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f" returned: 0 in 0.514s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] <== create_volume: return (1096ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:31 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Attempting download of 7bf73984-c6b1-492b-96dc-881be67623b0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7bf73984-c6b1-492b-96dc-881be67623b0', 'metadata': {}}])) to volume 6df30db3-85f0-4424-88da-737fc546ef3f. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 20:04:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Acquiring lock "cinder-85b1cb6d-6a31-4646-b0ae-8d57dfce574e-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:32 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8324bb69-4617-4c59-863b-3db23dcf91d6]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.799s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bf73984-c6b1-492b-96dc-881be67623b0_ms38y3ob {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:32 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:04:32 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Deleted volume successfully.
Sep 17 20:04:32 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Lock "cinder-85b1cb6d-6a31-4646-b0ae-8d57dfce574e-delete_volume" acquired by "delete_volume" :: waited 0.674s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bf73984-c6b1-492b-96dc-881be67623b0_ms38y3ob" returned: 0 in 0.651s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:32 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf73984-c6b1-492b-96dc-881be67623b0_ms38y3ob {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:33 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Acquiring lock "cinder-quobyte-85b1cb6d-6a31-4646-b0ae-8d57dfce574e" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:33 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-24fbde4a-5d6f-49c3-b4eb-3c6c55f30b7b tempest-CinderUnicodeTest-28640829 None] Lock "cinder-e0a40972-141e-448c-b0e0-566a5d64d26c-delete_volume" released by "delete_volume" :: held 5.648s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf73984-c6b1-492b-96dc-881be67623b0_ms38y3ob" returned: 1 in 0.981s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf73984-c6b1-492b-96dc-881be67623b0_ms38y3ob' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 20:04:33 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3ffa50-0691-4f85-8f2d-0b3f13569a8b]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:33 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Lock "cinder-quobyte-85b1cb6d-6a31-4646-b0ae-8d57dfce574e" acquired by "delete_volume" :: waited 0.208s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91ed12c-cd38-4870-8056-926fdd0b51f5]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:34 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Flow 'volume_create_manager' (22f22a6d-1b4a-4ea4-b20f-23b2e267f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8f9937-6032-46e2-8cba-11e682bdbcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8f9937-6032-46e2-8cba-11e682bdbcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-796958867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05918b71-625b-4c42-b21f-2155c262f1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321c4dd194f411e978ddb23031f34d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:33Z,use_quota=True,user_id='8a9bc1a0b7d44de79111128c268d9bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ed744a-c42e-44d8-8307-b5becd6411d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ed744a-c42e-44d8-8307-b5becd6411d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14843c5-c843-49bf-b6a9-42c200e7849a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14843c5-c843-49bf-b6a9-42c200e7849a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05918b71-625b-4c42-b21f-2155c262f1aa', 'volume_name': 'volume-05918b71-625b-4c42-b21f-2155c262f1aa', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038cff10-7c22-4942-9257-6c789f0474a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038cff10-7c22-4942-9257-6c789f0474a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fc6255-5fc5-441b-9453-8c651870e5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:34 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Volume 05918b71-625b-4c42-b21f-2155c262f1aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05918b71-625b-4c42-b21f-2155c262f1aa', 'volume_size': 1}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f842dabc2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-796958867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05918b71-625b-4c42-b21f-2155c262f1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321c4dd194f411e978ddb23031f34d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:33Z,use_quota=True,user_id='8a9bc1a0b7d44de79111128c268d9bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)}" {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Creating volume 05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:04:34 devstack cinder-volume[83122]: INFO cinder.volume.drivers.remotefs [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] casted to 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b
Sep 17 20:04:34 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa 1073741824 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:34 devstack quobyte-client[83143]: System call of process 101586 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD" returned: 0 in 1.172s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:35 devstack quobyte-client[83143]: System call of process 101587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:35 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=170, name=volume-05918b71-625b-4c42-b21f-2155c262f1aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e" returned: 0 in 0.803s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa 1073741824" returned: 0 in 0.507s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-85b1cb6d-6a31-4646-b0ae-8d57dfce574e" returned: 0 in 0.369s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa" returned: 0 in 0.250s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] <== create_volume: return (869ms) {'provider_location': '10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'} {{(pid=83122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:35 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Lock "cinder-quobyte-85b1cb6d-6a31-4646-b0ae-8d57dfce574e" released by "delete_volume" :: held 1.967s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fc6255-5fc5-441b-9453-8c651870e5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05918b71-625b-4c42-b21f-2155c262f1aa', 'volume_size': 1}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f134a4b-683e-43bc-9bdb-c8433d5111c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD" returned: 1 in 0.997s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] 7bf73984-c6b1-492b-96dc-881be67623b0 was raw, converting to raw {{(pid=83122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:36 devstack quobyte-client[83143]: System call of process 101598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:36 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=169, name=volume-6df30db3-85f0-4424-88da-737fc546ef3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:04:36 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Volume volume-05918b71-625b-4c42-b21f-2155c262f1aa (05918b71-625b-4c42-b21f-2155c262f1aa): created successfully
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f134a4b-683e-43bc-9bdb-c8433d5111c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Flow 'volume_create_manager' (22f22a6d-1b4a-4ea4-b20f-23b2e267f017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f" returned: 0 in 0.417s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7bf73984-c6b1-492b-96dc-881be67623b0_flwuf7endevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 20:04:36 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Converted 0.00 MB image at 0.00 MB/s
Sep 17 20:04:36 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:36 devstack quobyte-client[83143]: System call of process 101601 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:37 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-bb26ff5f-9a08-498b-b53e-5c0695295e66 tempest-SnapshotDependencyTests-1861824171 None] Created volume successfully.
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f 1G" returned: 0 in 0.580s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Created reservations ['212e0082-d110-4991-9131-1ddeab65a8c1', '396d9b57-14ab-4e25-95a6-44d680d088ea', 'f7b2366b-04a9-4e75-ae63-8b5937db84c7', 'edaf535a-33b3-4572-8ee3-019f21cc9c4c'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6773e953-9cb4-424e-b5b6-c71de0556850]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:37 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:37 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Creating offline snapshot 447c445a-971e-40cc-bf6a-0e559328c641 of volume 05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f" returned: 0 in 1.004s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[386c1112-89eb-4967-8022-c1539189c773]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.530s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:38 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:04:38 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Deleted volume successfully.
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-0f85b038-ff15-4cde-bc09-ba09eb0c62ac tempest-CinderUnicodeTest-28640829 None] Lock "cinder-85b1cb6d-6a31-4646-b0ae-8d57dfce574e-delete_volume" released by "delete_volume" :: held 6.335s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa" returned: 0 in 0.778s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 1G {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:39 devstack quobyte-client[83143]: System call of process 101607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f" returned: 1 in 1.033s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Downloaded image 7bf73984-c6b1-492b-96dc-881be67623b0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7bf73984-c6b1-492b-96dc-881be67623b0', 'metadata': {}}])) to volume 6df30db3-85f0-4424-88da-737fc546ef3f successfully. {{(pid=83122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Temporary image 7bf73984-c6b1-492b-96dc-881be67623b0 for user 4db27ad1704f49c98db09b72be7eef36 is deleted. {{(pid=83122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG cinder.volume.volume_utils [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Marking volume 6df30db3-85f0-4424-88da-737fc546ef3f as bootable. {{(pid=83122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 20:04:39 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=171, name=volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 1G" returned: 0 in 0.417s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): qemu-img rebase -u -b volume-05918b71-625b-4c42-b21f-2155c262f1aa -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:39 devstack quobyte-client[83143]: System call of process 101616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Copying metadata from image 7bf73984-c6b1-492b-96dc-881be67623b0 to 6df30db3-85f0-4424-88da-737fc546ef3f. {{(pid=83122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 20:04:39 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Creating volume glance metadata for volume 6df30db3-85f0-4424-88da-737fc546ef3f backed by image 7bf73984-c6b1-492b-96dc-881be67623b0 with: {'image_id': '7bf73984-c6b1-492b-96dc-881be67623b0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '836fc204943aa31266a74271e71bb322', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 20:04:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] CMD "qemu-img rebase -u -b volume-05918b71-625b-4c42-b21f-2155c262f1aa -F qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641" returned: 0 in 0.389s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:04:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641" returned: 0 in 0.327s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:40 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Setting permissions: /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa -> 1000:1000 {{(pid=83122) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 20:04:40 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641" returned: 0 in 0.579s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.info" returned: 0 in 0.533s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:41 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.info is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:04:41 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.info {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbe5cb6-9d17-4892-a035-5efc80b64354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df30db3-85f0-4424-88da-737fc546ef3f', 'volume_size': 1, 'image_id': '7bf73984-c6b1-492b-96dc-881be67623b0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf73984-c6b1-492b-96dc-881be67623b0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '836fc204943aa31266a74271e71bb322', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5da236a801f84f96aa4af4c2c6ab6395', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaee23db70c67dddb7922b2ffb8454b9fc57e1d1823baa906339c377accb7eb551e80e0a6cdad4bea50f636e0dfd8002477c224bce76526832635db87428cee6', 'id': '7bf73984-c6b1-492b-96dc-881be67623b0', 'created_at': datetime.datetime(2025, 9, 17, 18, 4, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 18, 4, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf73984-c6b1-492b-96dc-881be67623b0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f842283bb80>}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:41 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a17c30d-4d9a-479b-bb7e-7c80e3201266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.info" returned: 0 in 0.433s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:42 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.171s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:42 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Volume volume-6df30db3-85f0-4424-88da-737fc546ef3f (6df30db3-85f0-4424-88da-737fc546ef3f): created successfully
Sep 17 20:04:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a17c30d-4d9a-479b-bb7e-7c80e3201266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:42 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Flow 'volume_create_manager' (db45db2a-e8fd-4c6b-929e-22bd0a25b27a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:42 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-12bb8b3b-729e-4fe5-a61f-ba1452f3f763 tempest-VolumeImageDependencyTests-1192178731 None] Created volume successfully.
Sep 17 20:04:42 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-bba000f5-3b7f-4c28-9938-f1cd25763289 tempest-SnapshotDependencyTests-1861824171 None] Create snapshot completed successfully
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Acquiring lock "cinder-6df30db3-85f0-4424-88da-737fc546ef3f-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Lock "cinder-6df30db3-85f0-4424-88da-737fc546ef3f-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:43 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Acquiring lock "cinder-quobyte-6df30db3-85f0-4424-88da-737fc546ef3f" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Lock "cinder-quobyte-6df30db3-85f0-4424-88da-737fc546ef3f" acquired by "delete_volume" :: waited 0.015s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[19801b61-7253-41b8-abf6-ddf70ecabc98]: (4, 'raw') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:43 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f" returned: 0 in 0.620s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:43 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Flow 'volume_create_manager' (9bffa0bd-27e6-40ba-bfa9-65ae57cf9b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc61335-149e-417a-b4e5-b17ccb6fb0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc61335-149e-417a-b4e5-b17ccb6fb0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T18:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cecde0a-a837-492f-8d95-0f2d8bca15d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321c4dd194f411e978ddb23031f34d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T18:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=447c445a-971e-40cc-bf6a-0e559328c641,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T18:04:43Z,use_quota=True,user_id='8a9bc1a0b7d44de79111128c268d9bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e95865a-2682-4098-84bf-ede8dd6421e6),volume_type_id=8e95865a-2682-4098-84bf-ede8dd6421e6)' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa313b8-41ce-408d-95b1-0ed6850c3012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa313b8-41ce-408d-95b1-0ed6850c3012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c53708-1771-47ae-8392-71d000d13e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c53708-1771-47ae-8392-71d000d13e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8cecde0a-a837-492f-8d95-0f2d8bca15d1', 'volume_name': 'volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1', 'volume_size': 1, 'snapshot_id': '447c445a-971e-40cc-bf6a-0e559328c641'}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a74ec8-bf42-48f0-a402-340f913d55c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a74ec8-bf42-48f0-a402-340f913d55c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d63881-aeb0-4912-b6a9-d53bac7c9f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:44 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Volume 8cecde0a-a837-492f-8d95-0f2d8bca15d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1', 'volume_size': 1, 'snapshot_id': '447c445a-971e-40cc-bf6a-0e559328c641'}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f" returned: 1 in 0.670s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f' failed. Not Retrying. {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.021s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-quobyte-447c445a-971e-40cc-bf6a-0e559328c641-8cecde0a-a837-492f-8d95-0f2d8bca15d1" by "_create_volume_from_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-6df30db3-85f0-4424-88da-737fc546ef3f" returned: 0 in 0.336s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:44 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Lock "cinder-quobyte-6df30db3-85f0-4424-88da-737fc546ef3f" released by "delete_volume" :: held 1.754s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-447c445a-971e-40cc-bf6a-0e559328c641-8cecde0a-a837-492f-8d95-0f2d8bca15d1" acquired by "_create_volume_from_snapshot" :: waited 0.145s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Creating volume 8cecde0a-a837-492f-8d95-0f2d8bca15d1 from snapshot 447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Selected 10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b as target Quobyte volume. {{(pid=83122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-quobyte-8cecde0a-a837-492f-8d95-0f2d8bca15d1" by "_copy_volume_from_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-8cecde0a-a837-492f-8d95-0f2d8bca15d1" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] snapshot: 447c445a-971e-40cc-bf6a-0e559328c641, volume: 8cecde0a-a837-492f-8d95-0f2d8bca15d1,  {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319223c-91fb-4147-a035-27159f9c98f3]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Created reservations ['50dd6e7c-d2e5-4efb-b9e7-157fca4d9811', '877186ed-17f8-4c32-b265-4fed334cfd2e', 'bf2abf7d-18f0-4ab9-9984-a65efca59f8f', '4fdb40d6-b8ee-44b3-bd77-69c828bef116'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:45 devstack quobyte-client[83143]: System call of process 101661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641" returned: 0 in 0.605s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05918b71-625b-4c42-b21f-2155c262f1aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Creating direct copy from snapshot {{(pid=83122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:45 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c11b2ad-3830-48ed-8413-fdb363435ecf]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.229s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:46 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:04:46 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Deleted volume successfully.
Sep 17 20:04:46 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-bb28320b-9628-4a8d-b33a-1d198e71c694 tempest-VolumeImageDependencyTests-1192178731 None] Lock "cinder-6df30db3-85f0-4424-88da-737fc546ef3f-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa" returned: 0 in 0.611s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:46 devstack cinder-volume[83122]: DEBUG cinder.utils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1 not found in is_blk_device check {{(pid=83122) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 20:04:46 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:46 devstack quobyte-client[83143]: The server volume:cf89d26d-19af-4edf-9b79-baf4807fabac@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=cf89d26d-19af-4edf-9b79-baf4807fabac, inode=173, name=volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.179), requestorAccessMask=0
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1" returned: 0 in 6.416s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3855caa3-9b91-45e4-a818-5cfc3ec5c589]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa" returned: 0 in 0.583s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG cinder.image.image_utils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Image conversion details: src /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1 {{(pid=83122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 20:04:53 devstack cinder-volume[83122]: INFO cinder.image.image_utils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Converted 1024.00 MB image at 158.36 MB/s
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] File path /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1 is being set with permissions: 660 {{(pid=83122) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1" returned: 0 in 0.090s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-8cecde0a-a837-492f-8d95-0f2d8bca15d1" released by "_copy_volume_from_snapshot" :: held 8.862s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-447c445a-971e-40cc-bf6a-0e559328c641-8cecde0a-a837-492f-8d95-0f2d8bca15d1" released by "_create_volume_from_snapshot" :: held 8.939s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:53 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.099s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d63881-aeb0-4912-b6a9-d53bac7c9f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1', 'volume_size': 1, 'snapshot_id': '447c445a-971e-40cc-bf6a-0e559328c641'}' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ed1230-260a-4ad6-95d9-77e5143aa703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 20:04:54 devstack cinder-volume[83122]: INFO cinder.volume.flows.manager.create_volume [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Volume volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1 (8cecde0a-a837-492f-8d95-0f2d8bca15d1): created successfully
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ed1230-260a-4ad6-95d9-77e5143aa703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83122) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Flow 'volume_create_manager' (9bffa0bd-27e6-40ba-bfa9-65ae57cf9b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83122) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 20:04:54 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-ad35d3f9-2a7a-4776-aa28-62e730788e0a tempest-SnapshotDependencyTests-1861824171 None] Created volume successfully.
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG oslo_service.periodic_task [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.093s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:54 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-edb3fc1e-9769-493c-9ad7-830bc62bef76 None None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-447c445a-971e-40cc-bf6a-0e559328c641-delete_snapshot" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-447c445a-971e-40cc-bf6a-0e559328c641-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:55 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-quobyte-05918b71-625b-4c42-b21f-2155c262f1aa" by "delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-05918b71-625b-4c42-b21f-2155c262f1aa" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-quobyte-447c445a-971e-40cc-bf6a-0e559328c641" by "_delete_snapshot" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-447c445a-971e-40cc-bf6a-0e559328c641" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Deleting offline snapshot 447c445a-971e-40cc-bf6a-0e559328c641 of volume 05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] snapshot_file for this snap is: volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef08cfa9-be17-4bde-9748-ab07c476c820]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:55 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641" returned: 0 in 0.397s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:56 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.remotefs [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05918b71-625b-4c42-b21f-2155c262f1aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 20:04:56 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb0f867-618c-43dc-bba0-fb9cc6f0a692]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa" returned: 0 in 0.416s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641" returned: 0 in 0.226s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:56 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa.447c445a-971e-40cc-bf6a-0e559328c641" returned: 0 in 0.110s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-447c445a-971e-40cc-bf6a-0e559328c641" released by "_delete_snapshot" :: held 1.446s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-05918b71-625b-4c42-b21f-2155c262f1aa" released by "delete_snapshot" :: held 1.478s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Created reservations ['7bd79dfc-f463-4783-824b-8fae6211bfea', '6773cfca-8024-4f96-8cd1-d2dde2170eab', '9b3978c5-d9bf-4bce-964d-54b8c2472051', 'd55aff80-9f99-4a4f-ae60-6677a80ac3d1'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:57 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Delete snapshot completed successfully.
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-f4ef9ad9-00c5-4c71-ac25-29d61f8926ad tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-447c445a-971e-40cc-bf6a-0e559328c641-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-05918b71-625b-4c42-b21f-2155c262f1aa-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-05918b71-625b-4c42-b21f-2155c262f1aa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:57 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-quobyte-05918b71-625b-4c42-b21f-2155c262f1aa" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-05918b71-625b-4c42-b21f-2155c262f1aa" acquired by "delete_volume" :: waited 0.020s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6510c66-f150-4fe8-9e8d-009bac739907]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:04:57 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa" returned: 0 in 0.412s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:58 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-05918b71-625b-4c42-b21f-2155c262f1aa" returned: 0 in 0.118s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:58 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-05918b71-625b-4c42-b21f-2155c262f1aa" released by "delete_volume" :: held 0.697s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:04:58 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Created reservations ['45e49cb1-d1fa-4610-bbe4-637449ffcc19', 'e6fb4e90-61f4-4b20-8042-c4a958958a05', '09fd9d44-3b67-4e77-af9e-239297fa0f6a', 'a15c165a-f253-437b-a16f-ce6cec1de25b'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.090s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:04:59 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Deleted volume successfully.
Sep 17 20:04:59 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-c1ad707e-6463-46e1-a1ab-0dd8637bd4af tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-05918b71-625b-4c42-b21f-2155c262f1aa-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-8cecde0a-a837-492f-8d95-0f2d8bca15d1-delete_volume" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-8cecde0a-a837-492f-8d95-0f2d8bca15d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=63,cinder:UPDATE=70,cinder:INSERT=24,cinder:DELETE=6 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:05:00 devstack cinder-volume[83122]: WARNING cinder.volume.volume_utils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "cinder-quobyte-8cecde0a-a837-492f-8d95-0f2d8bca15d1" by "delete_volume" {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-8cecde0a-a837-492f-8d95-0f2d8bca15d1" acquired by "delete_volume" :: waited 0.013s {{(pid=83122) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b61c298-a972-4f00-8a8b-5fd2a0554c5f]: (4, 'qcow2') {{(pid=84128) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1" returned: 0 in 0.375s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1 {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:05:00 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] CMD "rm -f /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa/volume-8cecde0a-a837-492f-8d95-0f2d8bca15d1" returned: 0 in 0.103s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-quobyte-8cecde0a-a837-492f-8d95-0f2d8bca15d1" released by "delete_volume" :: held 0.649s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG cinder.quota [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Created reservations ['e85fe48f-f709-4fdf-a85b-682c48a3d40a', '98e4882f-757d-4eaf-9e04-9ccb5a94fddc', '847712b7-317e-423a-87d0-8ee0e488cb15', '05b14a96-1fd8-49c3-ac25-eb4321201bac'] {{(pid=83122) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b': None} {{(pid=83122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG cinder.volume.drivers.quobyte [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Available shares ['10.10.41.181/cinder-vol-4e810fb9-5e66-478e-a81e-18014d44e93b'] {{(pid=83122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.lockutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG oslo_concurrency.processutils [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/3b809e98b92af93c976b621ababa9daa" returned: 0 in 0.102s {{(pid=83122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG cinder.manager [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Notifying Schedulers of capabilities ... {{(pid=83122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 20:05:01 devstack cinder-volume[83122]: INFO cinder.volume.manager [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Deleted volume successfully.
Sep 17 20:05:01 devstack cinder-volume[83122]: DEBUG cinder.coordination [None req-98dad0c5-5634-421f-90b7-ad3979986f88 tempest-SnapshotDependencyTests-1861824171 None] Lock "cinder-8cecde0a-a837-492f-8d95-0f2d8bca15d1-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=83122) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 20:05:11 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:UPDATE=70,cinder:SELECT=49,cinder:DELETE=6,cinder:INSERT=14 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 20:05:11 devstack cinder-volume[83122]: DEBUG dbcounter [-] [83122] Writing DB stats cinder:SELECT=2,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}